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ABSTBACT • " ' , n ' 

This .dccuaent coiftaip^ suiiaries of thirty-tvo 
research^ projects supported by the- Bational Center fcr Health 
Services Besearch (HCHSB)' ufider authority 'a;e the Biergency Medical 
Services (EMS) Systems Act. (Focus of these research projects is to 

^desctibe, explain, and predict the* perforaanpe cf tore than 200* BMS 
systewS being established under Ti.tle HI of the'public Health 
Services Actr and to prescribe necessary- iaproveaents. ) A brief 
overviev of the EMS systeas researclC ptpgraa pr€ced€s the project 
suaaaries ai^d includes the scc5pe and pprpcse, approach; pxograa 
objectives, iaaediate research cpncerns, and dif f icultlei* 
encountered. The project saaaaries, alphabetized according to title 
a'id varying in l^ngti^ (froa two to s^ven* pa^g.€s) , each injclud^ the 
follovihg: title, grant ' nuaber, grantee' institution, principal 
investigator, fuziding leVel, total project period, significamp^, ' 

^project description, programs, and disseainatioa of i;esearcb results 
(includes publications, presentations, instances of techaical 
assistaiice, ^afid consultation*) Soie r^resentative project titles are 

.Anal'ysis and Therapy of Lif'^-Threatening £aerg,€nci4s, Coaputer "^ased 
Consultation* in Care 6f erit^icaily 111, ^Developient 'of a Guicle for 
^^§..f^JRMicaUons,^^^ Evaluation of ileaentsi^n a^ ^ 

• Cdaaiinity-iide EMS Systea, Myocardial Infarcti<^n Pxedicticn in 
Eaerqeacy Booas, and Telephone Protocrols for Emergency Boca Services. 
A' 14st of' available publications in ZJ!S is attached. (?M)* • 
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fWTIOfiAL CENTER FOR HEALTH SERVICES RESEARCH . 

RESEARCH M/UiAGEMENT SERIES • 

The Research Management .Series describes pro^ramatic rather than 
.technical aspect?«of the HCHSR research effort. Infoniiation is • 
presented on the NCHSR goals, research objectives, and'^prlorities ; 
in addition, tKis series conta.itrs administrative information i^n 
funding, lists of grants , and contracts, and special programs. 
Publications in this series are i/itended to bring basic information 
on the NCHSR and its mag rams to resea*rch planners, administrators,* 
and others \^ho are ipmr/ed with the allocation of , research resources 

< * * 

ABSWACT ' ' 



Summaries of research projects 'supporte4 by the National Center 
for Healthy Services Research: {NCHSR) during 1977, under authority 
of Section 1205 of the Emergency Medical Services Syst^s Act. 



» > 

. ^ ' . FOREWORD ' . . ' 

^Thfe fiational Center^ for 4i^a 1th Services Research is responsible 
for 'aKteVrristering a program of applied research directed specifically 
at Improving the effectiveness' and efficiency of more than 200 
regipnal Efip.ergency Medical Services (EMS) systevT^s which 3re i)eing 
•establrshed und&r Title XII of the ^ubTic Health Service Act. 
Vi^opous affortsfat the Fecteral, .State, *nd local levels are .bringing 
about significant changes in the ways in. which emergency care is 
deli vered,' and jjhese new policies'are matters of- considerable, public 
interest, t '' ' 

r ^ \ ' . 
The research co'rnuaity is being as^ked to test the 'assumptions 
on which EMS polici.es are based, describe new options and thei(^ 
probable consfequerrces , and determine ways to Pfeasure the effects of 
existing and alternative policies, f-toreover, the results of EMS 
research are fequired'to be- useful and timely, and must include 
specific recaTF>endations for improving system peVformance. 

EMS systems are beiog established in a.climatfe of increasing 
concern about the costs of health care^ and the research progranf , 
has had some succe^^s in stimulating new ideas about •ssystems whicK 
are designed to be affordable as, well as effective.' As EKS system^ " 
planners and managers gain greater appreciation of the value of 
information obta'ined through wefl-designed research projects, we are 
increasing our efforts to provide them with the results^ ^f these 
stuc}4es intelligib>y and pranptly. 



Gerald -Rosenthal, Ph.D, 
Director. 

September 1977 
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Overview of Emer^ncy Medica-l Services -Systems Research Program- 

Introduction ' - e> • .•■ 

* Section^l?06 of the Emergency Medical Services (EMS) Systems Act of .1973 
(Public Uw 93-154) and of the EMS Amendments of 1976 (Public Law 947573) 
Suthori-ze a program of- research in "emergency techniques, methods, devices*,^ 
and delivery." Reports of ;iiiese studies must "contain recomvendations an'd . 
ya plan of .action for. applying the results' of the research .... ^to Improve 
^t\\^ delivery. of emergency medical Services.'!* The National Center for Health 
Serviced Research (NCHSR), an agency of the Heal th' Resources Administration, 
' is the DHEH organization responsible for administering this applied research ' 
effort, and considers EMS research one of its niost important programs. 
. *■ • . . , ^ , • 

Scope and Purpose ^ 

The EMS Syst^ Act and Ajnendnvents encourage 'the development of regional 
systems intended to provide effective efnergency services- to everyone who. 

^ needs such care» arid* therefore the EMS research progratn focuses grin^rily on 
ways to determine how^^ effectively and efficiently eachiEMS system as a whole 
\s meetfag these objectives, how weTl Jne elements which comprise the system 

^ are fuijctioning individually and collecti.vely, and which changes in the system 
are likely to produce the greatest improvement. - 

This focus distinguishes the EMS research 'proflram from a number of parallel 
and complementary activities. For example, the Divisiort-of Emergency Medical 
Services, Health Services Administration, promotes the establishment of EMS • 
systems, provides technical assistance .to them, and monitors their compliance 
with the provisions of the laws and regulations* This agency and its 
constituents are an important group of. users* of research results, therefore, 
b&jt they do not thenlselves conduct formally-designed detailed investigations* 
The National Institutes of Health carries out both clinitaT and bipmedlceil 
research on many of the illnesses and injuries for which EMS systems provide 
initial care. Investigations into the causes and treatment, of ^myocardi a u 
infarction (ffational .Heart, Lung, and Blood Institute), .trauma and burns 
(National Instftute of General Medical Sciences), and central ney^vous system 
injuries (National Institute of Neurological and Communicative Disorders and 
Stroke), for example, produce essential information for Improved emergency 
medical care. Biotr>edical and clinical research programs.are designed to 
increase the fund of medical knowledge, however, and are not directly concerned 

' with the significant problems surrounding the , organization, financing, manage- 
ment, or .evaluation of^tfre systans^whtch provide emergency services. Legislation 

. :4i^W^.esiab,mhe4.the^ite4ionS4.Cente 

Sections 304 and 305 of the Public Health Service Act, authorizes research', 

Revaluation, and demonstration projects concerning the accessibility, accepta- 
bility, planning, organization, dis'tribution, technology, utilization, quality, 



and financing of health services and systems generally; A njonber-of investiga-* 
ticins of the relAlonships a^ conflicts beVmen EMS s^stetns and other ^health 
care delivery ^programs are bueing supported under NCMSk's general activities,* 
but studies, which focus on .the direct effects . of those service activities which 
are specified in EMS legislation. constitute the categorical EMS jres^ar-ch 
program and are described in this document. » ' • . 

Ln sunrnary,, the EMS* research procram established under Section 1205 consists of 
investigations designed to describe, explain, and predict the perf^ormance 9f 
EMS systems and their components, and' to prescribe necessary improvements. 
The product of this research is valid and 'useful information needed by planners, 
policymaker^ and Dth^r health programs. The Division of EMS needs these 
fi/idings to carry out its responsTblHties for technical assistance, project 
monitoring, and diss^inating ijiformation. When the efficacy of diagnostic and 
therapeutic devices and procedures has been established throtigh biomedical and 
clirtical investigations, the EMS research program examines their effectiveness- 
and their costs in existing service Systems. ^The research prograim also 
identifies issues surrounding the brganizatfon, management, and financing of 
EMS systems which may impinge on.qtjier health care concerns (e.g., cost- 
containment, ^assessment of quality? of carej^malpractice) , so that these problems 
can be pursued. by NCHSR. , . • » • 

Approach . ' . . , ^ 

The information produced through the EhK research program must be both 
believable and useful, and therefore it is essential that: * 

(1^ The research projects are designed and conducted according to 
accepted scientiffc principles, with proper^^ttention to 
reliability, validity, and generalizability^ The results of 
these investigations , are intended to replace the* e^cisting fund 
of anecdotes and expert opinion; they are used to recommend the 
allocation of large quantities of public resources, and therefore 
. both the-research results'and the data and methods on which the 
results are based must be verifiable and open to public and 
sci^ttfic scrutiny. , \ V • 

< ^ , ' • . 

(2) The findings include plausible reasons for believing that 

- improvesnents in system performance will result from the changes * 
recommended. It is difficult to determine causal relationships 
in studies of this sort^ but hypotheses can be formulated and - . - 
tested and theoretical framewo^9ks can be Bnployed to relate the 
results to pther^frjvestigations. 

(3) ]^Whenever possible, the-studies are cojjducted, or the results 

.tested, in operating service systems so* that unexpected obstac-les 
and unanticipated consequences can be identified and realistic 
Solutions- proposed. " " ■ ' ' ' • - 



(4) The resuUs^are disseminctted promptly and widely, to administrators ' 
■ and>pl_anner^ as well as to-ot-her investigartQrs. . 



Objectives . 



Better evaluation methods and measur^ are essential if we are to detemlhe 
the extent and fjuality of emergency care being provided at present,' and to '■ 
recommena methods to improve systerp performance. 'At this stage in the 
« development of a national network* of EMS systems, the' objectives of the EMS ' 
• y^esearch program are to: . • , • * ^ 

• (1) Develop reliable arid valid measures of jystem input, process, 
and output which carj be used to evaluate and compare system 
and subsystem performance. • ' • 

(2) - Test these measures id operating EMS systems, -to insure that , ' 

their use is. feasible, acceptable, and economical , 'and that 
they are sensitive and speci-fic e;nough to reflect important 
.differencei in systan organization and administration. 

(3) Use these measures to evaluate and compare different EMS systems 
and components, identify and cfescribe-Jthose factors associated 

^ with. greater effectiv^ess or lower costs, and devel(S plausible 
reasons or testable hypotheses concerning the differences 
discovered. 

. . (4) Recommend and justify changes in EMS policies, or in ^ystan 

, configuration, administration or financing, which will improve 
the responsiveness and quality and. decrease the costs of providing 
emergency care. 

Ifnmedlate Research Concerns 

The -program concentrates on evaluative research, including analyses of the" 
performance of systems and their components, and on the development and 
testing of pertinent measures. The primary purpose of all EMS systems is 
to provide appropriate care in life- threatening medical emergencies, "and 
therefore it might seem that research efforts could be limited to direct 
CQifiparisons of the effectiveness of different systems or different components. 
Without better measures of system inputs, processes, outputhsand boundaries, 
however, attempts to judge one system against another produce ambiguous -and 
' misleading results: ^ 

■ 0 Input measures must consider not onTy system resources '(such as ' 
ambulances or burn centers) but also descriptors of the number 
and the status of patients who are c^red for. Emergency victims 
are characterized less by the^kind of medical problem than by Its 
urgency, and therefore it is essential that a reliable index of 
severity be developed so that difference?^' in the case-mix''of' 
different systfens can be considered. ^ 
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) The managanen^ o,f cri'tiwl medical emergerTcles requires not* only 
.thSt diagnosis and treatment be correct, but that care be given 
• ^promptly and" often in a prescribed sequence.* Detailed descrip- 
tions. of proper treatment plans, often arranged as treatment - 
'protocols or* algorttfkns, are being designed ancl* tested. Measures, 
of the process of care can be estimated terms of compliance . > 
vith these algoritfmsj.-and both the speed aYid the quality of care 
gi.vfen. to different jDati eats, in the. same and in differnt EMS systan^, 
can then be. evaluated.* * . 

) The effectiveness/ .of Emergency services in terms of clinical Outcomes 
dannot be estimated accurately at this tinoe, since the -likelihood of 
survival and ful i recovery following critical, emergencies often depends * 
on the quality of in»-hospitaVand convalescent care. The medical " ^ 
efnergency stage of a life-threatening illness or injury copld arbitrarily 
be considered to have" ended when definitive treatment begjns and speed 
of response is no longer art overriding concern. Measlires of the patient's 
condition at one or several .points during the hospital course and at 
disch'argds^can be used as* intermediatte or t>^"oxiinate outcomes wh^n they can 
• . be sliown.to be adequate predictors of ther^end-results of Care. 

0 Different EMS- systertis view the boundaries of their responsibilities 
differently, in terms both of th*e authorities shared with other agencies 
and of the clientele to be served. Most of the patients (hanaged by EMS 
^ systans are not in imme^diate danger lOf death^'or serious disability; 
''.there is considerable disagreement concerning proper standards to 
evaluate the performance of EMS systems as "convenience clinics," and 
systentatic procedures for obtaining consensus are needed, to insure; 
that public ^expectations as well as professional opinions converge in . 
these standards. • ' • * * 

Difficulties • * 

The continuation and expansion -of ^this EFR research effort faces a rtumber of 
obstacles, among, which the following are noteworthy: 

(1) There are very few experienced investigators available to design 
studies of acceptable scien£ific merit, and fewer yet who have 
access-to appropriate sources of data'and adequate set,tings for 

field testing^ In addition, EMS research solicits applied Studies ' 
which can lead directly to^ changes in polnct]ps or in organization; 
many investigators tend to be cadtious and. conservative, and worry 
that, their efforts may be applied to policy decisions prematurely.. 

(2) Emergency medical care is a dramatic, fast-moving field, and 
.attracts'action-oriented, "can-do" people who are impatient with ^ ./ 

the researcher *s* need for accurate /data and detailed records. 
Many of the most critical decisions* 1n the mariageipent of an/ 
emergency fiatient must be made quickl/and must be based on 
incomplete information. Decisions' such as these are difficu-lt .to 
defend objectively,^ aod therefore are parti cuVarly troublesome 
subjects for conventional reti^ospective quality^assessment methods. 
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Summary 



(3) Rational cohcei;ns atjout. the rising, costs of bealth^care are'* " 
important to researchers, but have not yet attracted the \ / ^ 
interest of rtost EMS system planners and managers, who are j 

• providing a service which society clearly values highly. ' - / 
Admini-st raters rAk-4rrcreasBS in aystem efficiency and ^ * - ' 
productivity far below accessibility and quality of cire as 
EMS program Qbjectives, and nevV-devices ape w6l corned. enthusi- 
asttcally, whatever the costs. • , , ' ' ^ 

(4) 'It IS often difficult to identify all of those who ar^ directly 
responsible for each of the .steps in providing emergency medical 
services, EMS systems are not widely accepted and financed as ' 
l)ubl1c' services, an(j"many of the resources used by these systems* 
ar6 natbnder the direct control of a' designated manager. Clinical 
care for Individual patients is provided by a variety of pro- 
fessional and pSraprofessioncil personnel, foMowyig different 
proceQures and responding to different pressures and authorities. 
The' emergency phase of an Illness or Injury blerxls almost imper- 
ceptibly into the definitive and restorative phases, responsibilities 
for' prescribing and .administering- treatment change subtlyv and 
clinical imperatives shift from the maintenance ^f life to the less- 
ing bf disability- An investigator finds it exceedingly difficult 

to discern the operating fules of the system and to gain access to 
all necessary data, and must be- especially meticulous in obtaining 
and evaluating information acquired from different sources. 

(5) • EMS systems^ respond to any ,type of medical emergency at any time. 

Life-threatening events are relatively uncommon occurrences^ in a 
community,, and therefore investigators must screen large aTOunts-' 
of datfei- to find items -of interest. Information-gathering systems 
designed to meet management-specifications are seldom adequate to 
^ meet an investigator's ^needs for accurate and complete data, but 
EMS personnel are understandably reluctant to collect additional 
information to be used primarily for research. It is difficult 
for a researcher to defend the value of a sophisticated informa- 
tion^ system whicf? will be of no immedidate direct benefitto the*" 
service provider^ but without good data an investigator cannot be 
certain that hisz-f indings are reliable and his* recommendations 
if^efu-1 in other systems or other -emergency conditions. 



During- -recent-TearrrTJtariTjIll^-T^^^^^ oj^ *mo'dels* • 

' of ideal systems,, under the assumpt-ton that components which later we're shown 

- to be ineffective, duplicative, or non-productive cpuld then i)e elfminated. 

- , In the face of growing concerns about the incre^s'ing costs of health care, 

EMS system planners will soon be faced with--the need to choose between alterna- 
tive uses of EMS funds and personnel. They^will also be required to defend the 

J 
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allocation of resources for en^rgency care, rather than for other necess-ary 
health and social programs; EMS systenr imperatives will be 'scrutinized, 
crlticised^/and revised^ EMS research is intended to produce evidence which 
can help po>icymakers di national .and local levels make these <f?fficult and 
unpopular choices. Summaries of the investigations in progi^ess are being 
distributed widely to stimulate further r^esea^chin this extremely important 
and challenging ^ield-, to solicit the help of system managers ii^ prpviding 
new research settiVigs,- and to describe th^ .purposes aod the value 'of these 
studies to policymakers. Principal investigators will be glad to provide' 
further details about theiV, proje(^s to .snycme interested, or inquiries can 
be directed to: ' ^ ( > • . 

National Center for Health Services -Research 
^ * ^ Attention: EMS * • . - 

^ Center Building 
• ^ ,3700 East-West Htgtjway ' ^ ' * 

Ryattsville, Maryland 20782 ' • 
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TITLE : Analysis, and Therapy of Life-. ^ QRANT NUMBER : 5 ^18 flS 01833." . 

' ^ . Threatening Emergencies, , ; ' ' 

G'RANTEE INSTITUTION :' Professional Staff Association of. Los Angeles County 
; . * Harbor General Hospital 

Fj^INCIPAL INVESTIGATOR : . • FUfflING LEVEL : $ 91,091 FY 77 

' • . $100,085 FY- 7& . 

.William.C Stioema-ker, -M. D. ' , . ^ . ^ • • 

Chiefs Acute Care Center . ^ . 

Harbor General Hospital * ' . • ' * 

1000 West Carson Street . fOTAL -PROJECT PERIOD : 6/30/76- 

Torrance^ Californ^ia 90509 ^6/29/78 

. (213) 328-2380, x -1308 • ' - ' . ^ . ^ - 

" . ■ . ' • • • • • . . 

• SIGNIFICANCE : > , • . ' 

, The ffrSt purpose 'of this study is to develop criteria for adequate* 
resuscitation of patients suffering life-threatening medical catastrophes 
arising outside, as well as; within, the hospital. The'crjteria are 

..based on clinical and physiological data "that are available at the bedside 
for decisionrmaking.' Second, the project is developing a protoebl describ- 
ing the steps -required for aptimum^ resuscitat%)n ^nd subsequent care of the 
eiTtergency victim. Finally,^ a oieasure of the severity of illness will be 
created for use \r\ emergency conditions. This index of the severity of 
illness, must be relevant 'to an important outcome measure, such as survival 
from an acute life-threatening problem, the rationale Being that if the 
monjtored value or a physiologic variable can' be related, to mortalUy of^ 

'survival, it can be used^to evaluate both the Outcome and^the process. ' 
That is, the capacity of the ^severity index* to predict outcome will be 
tested by . prospective studies. If successful. It wilVbe used to monitor 
the adequacy of the'-process of medical care in the emergency's Ituat ion. . • 
The index must suitable. for use at the bedside dur.ing acute illness ^Vid 
emergency N^ndit ions to aid >n clinical decision-making at tijnes of crisis. 

. The ^project) attempts to develop^ criteria for, and ultimately ;lesign, a 
protc^l or patient care algorithm for acute'l ife-threatening problems, 

^begfnmngat the Emergency Department but ulfimately. extending to both 
prehospital resuscitation by paramedics -and in^hospii^il catastrophes. 1/ 
successful, these protocol^will replace the present fragrfentejl and sometimes 
haphazard approach to resuscitation and critical care with op6 which proce!eds 

jSy^t-ematically, according tjo priorities deteniline^ by ihort^l'i ty-fnorbidi ty 
statistics and by a physiologic' index of severity based juppn fneasurements 

' .derived from monitoring 'cardiorespiratory^ functio.n. . » . ' 

In essence, the program is^direcfed toward more* expeditious jind more effective" 
res<iscitation guided, by presently available monitoril^ methods and knowledge » 



ERLC 



"f ■ 



William C. Shoemai,ker, ^hl.D., 



of the relative effectiveness of alternative types of ^herapeuti^ approacThes' 
as well ^s spfecific therapy. Ih^s information will be of'practicaT irriportance 
to Emergency DeparJ:ments and ICtIs where most of the acute crises are .or should 
be cared for. . * * 

It is judged that. at least; half of the estimated 700,000 annual deaths from 
acute emergencies could be. prevented. - •I'his . investigatiQl^ e;^^|j||te|^resses * 
this issue, the' reduction 'in mortal ity and morbidity of acaJ^^B^^PFieaii^ing 

emergencies which can arise through -improving the medical. c^liProcess . 

• \ ^ ' ' • '.^ ' ^ ' ' ' , 

. The ^second valuable prqduct of the pfoaect will be a 'seventy ihefex derived ' 
from monitored* cardiorespiratory variables which 'are wei'^hted according to 
the capacity of eaCh variable to predict survival or death. This product will 
be appli-cabte in any Intensive Care Unit o r Cpwi ^ency Department where complete 
cardiorespiratory measurements can be obtijjlCd.T^''^^^.^,.^^^^ . ^ . 

• ' " ' fij ' I 

The system for physiologic evaluation can a^so be used^to assess the relative 
effectiveness of alternative treatment 'metho'ds, SifA. establ ish their value 
for individuals or groups of patients-'" 

PROJECT DESCRlWrPN : . ^ * ' ^ * ^ ' 

Briefly, the study aimsr (a) to develop criteria for resuscitation gf 
patients entering^the Emergency Departgient; (b) to develop a decision lo^ic 
for the steps tn resuscitation; (c) to test this treatment protocql 
prospectively; an^(d) to extend the protocol to include *care given Jn the^ > . 
^ Intensive Care Un^^s^well as the Emergency Departn^en't. * ' ' , . 

The research setting is an 800-bed Counfy Hospitaf which is run by a full-' • 
time medical school faculty and a large* resfdant staff.- 

The study design involves one clinical service that uses the algorithm and 
two'.services that sarve as controls^ There is no cross-over 'of residents 
between these services'. Patients are allocated to each service On a daily 
^ bas;is; i.e., from 0800 on otne day to 0759 On (the next day," all surg'ical . ^ 
emergencies arei seen by the Green service, the following day they arev se^n • 
by the Yellow service, 'and the third day^by the Orange service, and so on- 
in this ^uence. — >^ . 

. • ' 

Initially; resuscitation is monitored^by simple meaas, but th^ number and 
'type or'physio\ogic monitoring measures increases rapidly in accordance with 
specific cj^iteria detehnined by process and* outcome measures. 



Process MeasiH^s ^ ."^ ' , 

Af algorithm was -devel oped, from data obtained by physiologic rijonitbrilig using* 
an intracardiac catheter to m^a^ure pressures and blood. volume. . Using the 
la^t available data set, this algorithm was able to perdict outcome in 94% 
6f a series of 113 critically ill patients.. The algorithm is now being tested 
prospectively and will bemused as a. measure of the. severity of illness; that • 
is, the probability of death is considered an index of the severity of the 



critical ijlness. 
8 
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PROGMSS: '• 



1.,^ A o^g-page algorithm for initial- resuscitation -(first 30. m1n.)vias 
' revised and'is now being "tested' prospectively as described above. 

2. A predictive index was designed and is now being tested as 
* described above.. ' ' . 

. ; 1.' A therapeiftic index based on the predictor is being developed. 

■ • ' / . ■ . 

4. Records of bM emergency patients entering the ED in the past 
three months^hav^ been reviewed, and form a baseline for 
. / . subsequent'"evaluations. » \ 

V PUBLICATIONS : 

'W. C. Shoemalcer, £. Pi ercha^U^r*- Chang, D. State: Prediction' of outcome 
and severity of iTlness by analysis of the frequency distributions of 
cardiorespiratory variables.; Crit. Care Med. 5:82,' 1977. • 

^ W. Shoemaker, F. S. Montgomery, D. H.*Elwyn, H. Levin, A. I. -Rosen: 

Early prediction of death and survivaTby prospective analysis of cardio- 
respiratory variables in postoperative shock pattents. In: Current Topics 
in Critical ^Care Medicine, Vol. 2, p. 44-59. Basel, S. Karger, 1977. 

P. Chang^ M. H. Weil, L.D. Portigal, C. Shoemaker: Prognostic indices-^ 
and predictors for pa-tients in circulatory shock. In Press. 



M. M. Shabot, W. C. Shoemaker^ D. State: Ah 'yvancecTtfarEa acquTsT^Tb 

for hemodynamics and O2 .transport variables at the bedside of critically ill 

patients^ In Preparation. . ^ ' 

* 

W. C. Shoemaker, P: Chang, R. Bland, L. Czer, M. M. Shabot, D. State: 
Cardiorespiratory monitoring in postoperative patients: I. , Prediction of 
outcome and severity of illness. In Preparation. 

W.X. Shoemaker, P. Chang, R.' Bland, L. C?ftc, M. M. Shabot: Cardio- 
re§piratory monitoring tn postcrperative patients-i II. Quantitative Indices 
as guides to therapy. In Preparation* 

W. C. Shoemaker: Cardiorespiratory patterns in various types of shock and 
their therapeutic implications. International Shock Symposium, University - 
of Arhus, Denmark, May 10-^12, 1977. In Press. 
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SIGNIFICANCE : ^ - . ^ • . * . 

Increased expenditures in Emergency' Department medicine are the .result, of 
several related developments: the proliferation of Emergency Department 
training programs, the increase in the-numbei^ arid technical capability of .* 
Emergency 4)epartment personnel, and the increasing numbers of patients turning 
to Emergency- Departments^f or care. Jn light of the' magnitude of these ^develop- 
ments, it is important to' justify the expendittjres. i4o»ieover, given our 
current political and- social climate^ which is caviling both for accountability 
.pf physicians antf for cost control, with na sacrifice in quality, it is not 
surprising that the quality of the care provided in these facilities has been 
questioned. ' ^ ' . P ^ 

"Yet, the Emergency Department has general ly^been neglected in any attempts to 
assess the quality of care being provided du^ to theJar^ge volumg of patients 
that seek medical Care there, the differences 'In emergent and non-urgent 

" patients, difficulty in foilow-up, and the concept that the Emergency Depart- - 
ment should serve. only to stabil ize patients rather than to^render definitive 
medical care/ While it is* essential to assess the qualjty of care provided 
in ^these settings, there, ane very few data about ^lie valtdity and reliability 

. of Various techniques of quality assessment applied in this type ftf health care 
unit. . ' ^ ' . • . 

This •study is designed to develop and test Criteria Mapping, a technique based 
on branching logic for evaluating, the process of^patient care through chart 
audit. The investigators are comparing Criteria Mapping to the most commonly 
employed method for evaluating process, the criteria list, to see which method 
better measures the care, according to the externaV standard of health- outcome. 

^n the criteria list method, a standard list of things to be done to or for 
^ all patients viith a specific diagnosis is set up. These lists are* usually 
either so general as to provide 1 ittle indication pf thq actual quality of 
patient care rendered, or so detailed and extensive that they require, the] 
^ysician to perform many tests and other clinical procedures not warraj»€ed - 
rbr every patient. Thus the physician may do just those appropriate piip^ejiures 
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> / • / . • .„ ' • 

for that patient, and yetf have a low sctfr^fe for not cpmplying with the wh 
.-list. For example, a 28-year-old-patient with chest pain due to a cold-, 
requires a- different workup and treatment from a 63Vyear-old patient with 
stabbing chest pain and -a prior Mstory of a heart attack. The same list 
-canno't be applied to the care of both patieats. ' ^ . 

^Criteria Mapping, in cervtrast^ organizes criteria for good care according to 
the specific patient characteristics tl^at should promp.t speciftc medical 
action on the patient's behalf. This*organizati<jn of the criteria allows 
for evaluation of the specific c^re received by any patient with a given' 
(Hsease or chief complaint. Evaluation of care by Criteria Happing, therefore, 
^ is expected to reflect the mqst important elements qf patient care in an^ 
emergency setting: i,e,, the quality of the .d^cf-siohs and actions taken under , 
significant time constraints* ^ 

The results of this study are expected to demonstrate that Criteria Mapping . ' 
provides ^n accurate ^evaluation, technique /or Emergency Department settings. 
Specifically, a Criteria Hap for. i]!&tiehts with chest pain/cardiac disea'se* . ! 
will be thoroughly evaluated and-available for use by the end of this project. * 

In general, quality of care a^essment techniques can be used to provide 
.information on two different levels of generality. 1) Within a given emergency 
facility, this information may^be used to identify problems in quality ^f 
, patient care rendered ^ajid to initiate corrective action to ii?^prove such process. 
On thfs level, the tecmique o-s' especially useful in any Emergeacy Department, 
be it a university hospital wittf residency training programs or*a comngnity 
hospital. Assuming appropriate corrective action, the ultimate benefit of 
improved c^re- accrues to th^ future patient. 2) Comparative evaluation may be 
undert'&ken/ The results of quality as^essmeots may be assigned value foV policy 
decision-making in terms of r^esougfca'al location or certification. 

PROJECT DESCRIPTION: ^ , ^ 



This research focuses on deve^ping feasible, valid measures for assessing the 
quality of care rendered to acutejy til patients. With primary attention to 
. comparing two .different methodnlogic approaches to this objective in the 
Emergency Departments of two ifospitals, UCLA, a university teaching hospital 
staffed. by house officers, aqd Santa Monica Hospital, staffed by full time 
private physicians., ^ . * 

Aa explained earlier, two different evaluation_techniques are-5>eing studied: 
Criteria Happing and the criteria list method. Both techniques require 
specification of the "process" of care — a series oV statements', called 
- \' criteria, specifying what shOiJId be done for patients. (The techniques^. ' 
however, differ markedly ^ the manner in which/criteria are organized.) 
Compliafice with a criteripset is determined by examining the medical records 
of patients, resulting in & stere for the gare the patient received. 

A meaningful 'comparison. of scores allowed by each evaluation technique is 
possible only by correlation with an externa.1 standard. In- this projecr, the 
external standard js the "outcome" or result of the care: whether the patient 
improved,, died, had to return to the hospital, ete. Thus, if the criteria 
, • map scores the process as "good,'' the outcome of the patient should also be 
Jgood*" 

ERIC ; -^^ . 
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The study is currently focused on patients who c<me to the ©nergency room 
with the chief complaint of "ch^st paia." Outcomes have beeiR selected for 
"two subgroups of patfenta^, dependi-ng upon whether the patients were 
admjttei to the hospital or discharged, following the emergency room visit. 

This simple Qutline of the Study^cJmits much of the research plan. Eor 
instance, 'obviously the outcome depends'on jiw^ny qther factors?'than the 
process of medical care (i.e., patient's attitude, the natural course of the . 
disease,, etc.). Careful attention ha^ been paid to selecting outcomes which 
ca/1 be influenced by good medical car*e; patient characteristics such age 
antf prior medical condition are stratifying variables to be entered in 
analysis of the data. Moreover,' medical records must be checked for ^ective 
bias agaii?st either evaluation method, ancl for reliability of recprde^rocess 
against actual process. Reliability testing of medical record abstractors is 
another necessary precaution, ^ ^ 

PROGRESS : / ' 

An extensile criteria map and' comparable criteria lists" have been developed 
to evaluate the diagnosis and management of patients who pT}esent to* an 
emergency room with chest pain. Each. criteria set — map and lists has b£en 
^proved by a panel of local physicians including practicing cardiologists,- 
family physicians, and univers'ity-hospiital-based cardiologists. 

Cutcomes of discharged patients are 'being assessed by means of interview, . 
questionnaire and EKG ^n the'patients' homei between 48 and 120 hours after' 
their visit to the Emergency Department, Thes^ devices are' intended to measure 
outcomes such as missed diagnoses of serious, disease symptom relief,' and 
satisfactioh with emergency room c^re. The home interview and satisfaction 
questionnaire are available in berth EnglisJ^^and Spanish'. 

Outcomes on admitted patients are collected by data -abstract frofn the patient's 
medical record.* These outcomes include necessary vs. unnecessary ajdmission, 
accuracy of the diagnosis, and mortality in certain subgroups of patients, • 

Data collection on thesfe variables is now beginning, following pilot testing 
of all data collection Tnstruments. ^- * * * 

DISSEHltoON : * . ^ ^ ^ ^ I ' 

^ • ^ 

A' preliminary study, completed before the onset Qf this grant, has been — 
accepted for publication in thte journal ,' Medical Care . Unlike the currerft 
s-tudy, il do$s not compare .results to the- list method nor does include- 
hospitalized patients. . - * . « ^ ' 
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SIGNIFICANCE : ^ > . - ' . 

Due to increasing pubViq interest and recent legislation, the ddvelopjnent 
and institution of. methods for ass6ssmeBt^f?d assurance of quality of health 
ca.re have become priorities for the me<ijca^ profession. Unfortunately' in 
spite of the obvious n6ed, thei^e is still little available in the way of 
widely applTcaj)le and acceptable operational systems for. measurement and 
assurance of quality of emergency medical care. ^ The Ecnergency Care Project - 
IS attempting to develop such a system for^ ex^luating the quality of medical 
care delivered to burn and vehicular injury patients in three regions of 
Flon-da. A particularly desirable feature of this proje(§tt lies in the fact 
that it takes severity of the patient's injury 'into account and therefore 
may result in a method to compare quality of care delivered to different 
populations.. ... 

PROJECT DESCRIPTION :^ ' '■ / ' 

— ' i/' 

The objective of tms project is to develop a fe^ible?, rej-'iable, valid and 
acceptable system for assessing the quality of care rendered to patients with 
traumatic emergenqies. This project involves testing the reliability and 
validit^^ji^^^njnstrument for assessment of care that was dfeveloped in a 
P^gP^ Pi^oject, supported by "the Floridtf* Regional Medical py-ogram. Quality 
ofV^re assessments are based on a sample of the data collected on all burn 
and vehicular injury patients coming to the emergency room's and admitted to 
one of four hospitals (representing the four categories of EMS' facilities in 
three Florida cities (Orlando, -Jacksonville, and Miami). 

An additior^J hospital in the Orlando region has been added\due to *a reorganiza- 
tion of one major hospitSt, which created a satellite instKution to care for 
a portion of its patients. The data collectors are nurse clinicians. Data 
collected bn all' burn patients and on admitted vehicular injury patients 
include: a) demographic; age, sex, and race, b) diagnostic; details on onset. 
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transport, pfior treatment and clinical findings, c) management; procedures 
and medications. In addition all diagnoses, procedures, and complications are 
coded and entered on a clinical coding sheet and an abstract of the medical 
record is prepared by^the nurse clinician for each admitted patient which 
summarizes the patient's hospital course. ' ' \ 

The reliability of data collectors is tested by having data collectors in each 
city completely recode and reabs tract samples of their own^cases at 6 month 
intervals (test-retest) and of each other's cases (interrater) . Simple counts 
of registry and coding discreq^ncies are computed for both test-retest data 
and interrater data. In addition, six physician evaluators compare- two, • 
abstracts frcHii the same patient and assess the degree of clinical disparity 
alon^. several parameters on a' 5 point scale^ * As. an additional reliability 
check for burn patients only, the data collector and the physician independently 
estimate the percent body surface area (BSA) and pfercent ful L thickness burn on 
the same patient at the same time. 

The Quality of Care Index is based upon assessments by trained physician 
raters concerning expected and observed outcomes of patients in the study 
hospitals. Raters use abstracts ^f'proces's and outcome, data recprded by 
nurse clinicfans. Abstracts provide data from the first 24 hours post ' 
admission for/ratin^xpected outcomes, and the rating of actual (observed) ' 
outcomes is ba^ed. upon , the entire course of hospitalization. The expected' 
and observed ratings are compared for each patient-and from them a new 
score is computed as- the index of quality of c-are for that patient. This 
numerical difference between observed and expected outcome ratings reflects 
the magnitude of the difference l)etween number and severity of observed and 
expected complications. Hence, the higher numbers reflect increasingly poorer 
results than expected. These results are independent of severity of illness, 
which has already been taken into account by the physician rater in t^e form 
of a prognostic jud^effle/it based upon clinical abstract. 

'Reliability of the -raters is being assessed in two ways: 1) a test-retest 
compajison where the rater assesses the same patifent.at a later time on both, 
expected and observed outcomes and 2) an interrater ccMnparison where raters* 
evaluations of each patient on each item an^ on the index score are compared. 
The validity of the quality of care index will be tested against a separate 
global assessment of each patient made by the physician rater. 

progress: / - . 
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1) By December 1976, 3301, burn patients {380 adajssions) and 1292 
^ - admitted vehicular Injury patients were, registered. / 

2) A system for coding^ and storage of all registt*y data on magnetic ' 
tffpe has'oeen developed, revised and is in full use. 

3) A special manual of instructions for physician raters has been, 
prepared and all raters have been trained/ There are 7 raters.^ 
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4) ' An pUnjiedVel lability and validity checks for data collectors and 
raters are ongoing. 

DISSEHiriATIOt^OF RESEARCH RESULTS - • 

Presentations related to this project are as follows: 

B.S. Linn,.J, Smith, and J. Langson. Vehicular Injuries in t^e Elderly. 
Presented at 28th Annual Scientific Meeting of the Gerontological 
Society, October 26-30, 1975, Loi/isville, Kentucky. ^ 

- B-.S.- Linn, J. Smith, S. Nickellr and S. Stephenson. Using a Trauma 
- ' Registry of Evaluation of Qi>ality of Care. Presented at 103rd APHA 
Anrjual Meeting, November 16-20, 1975, Chicago, Illinois. 

J., Smith, 0. Civetta, J.L. Lester et al.. A Simple Codiag System for 
* Traumatic;^ Injuries. Presented at 104th APHA Annual Meeting, 
October 17-21 , 1976, Miami Beach, Florida -r 
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SIGNIFICANCE : J 

The overall •objective of the proposed research is to provide a mechanism 
for upgrading the performs nce'^of ©nergency medical technicians (EMT's) 
and, thereby, to improve pre-hospital care for victims of emergency 
accidents and illnesses. It has been shown that proper intervention in the 
first few minutes following an accident or illness can be the difference 
between life and death or disability for the patient, 'In the case of heart 
attacks, a patient must be resuscitated within 4-6 minutes of a cardiac 
arrest. For. a victim of an autdfnobile accident, improper handling can result 
in permanent and totaT paralysis. The training and performance of EMT's is 
therefore crucial to the well-being of the general public, since anyone at 
any time can become art accident victim. 

To accomplish the above objective, this study is developing and implementing 
clinical algoritWns to be used by EHT's when monitoring and treatitig patients. 
Clinical algorithms are decision-trees with branching logic based on standard 
treatment procedures. ' • ' • * 

The results of this research have implicatiORS for several levels of personnel 
For policymakers, the rgsults will enable them to: a) make better and more 
meaningful^ assessments of the quality of care delivered by EMT's; b) determine 
system effectiveness in terms of dollars and efforts v^ia analysis of training 
arjd refesher training programs; and, c) pinpoint strengths^ and weaknesses in 
tfie emergency medical services delivery system. For instructors and for EMT's 
the project will permit more appropriate and structured training. For the 
general public, the project will result tn improved pre-hospital care. 

PROJECT DESCRIPTION : 

The project ,1s designed to develop clinical algorithms to serve as a teaching 
tool and guide to Emergency Medical Technici^in {EMT)^field performance. The 
evaluation mechanism, clinical algorithms, will be developed by a phased 
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process. A cardiac algorithm set -will serve as a nx)del for^ initial develop- 
ment, testing, and validation; subsequently other emergency clinical algorithms 
will be developejd, tested and validated based on the process set out in 
Phase I. The Cardiac ajgorithm validation process involves a "panel of 
experts" approach; the set was developed by an interdisciplinary group locally, 
with structured review and input by n^tionaV consul tatits. Following develop- 
ment, t^ cardi'ac algorithm set is to be pilot tested prior to Urge scale 
implemgfitation..' Data validity procedures and quality checks have been developed 
and will be. pi lot tested. 

, 10 cfate, the .algorithm set has been completed artS reviewed. The pilot test has 
begun; its functions are:'l) to collect baselioe data, for experimental design 
purposes; and 2) to test the developed data coTlection and validation tools • 
and integrate necessary changes'. D-IT-Paramedfc^ are currently being trained 
with the cardiac algoi'ithm set and data collection and validation will follow. 
Data r^orded on the instruments and forms will then be analyzed to yield a 
conpliance score. 

As previously mervtioned, Phase II will follow the research design developed 
•during Phase I and will test clinical algo'rithjns for other -emergency conditions 
such as trauna-or drug overdose. During the final phase, analyses wilJ be 
conducted' to identify relationships between selected background and experiential 
characteristics of EJ-fT's-and their performance. R^^sulting algorithm compliance 
data. will be used in the deve-lopment of structured refresher training. Alterna- 
tive 'refresher traininr approaches will be tested by analyzing changes in 
EFfr- performance over tine, to identify the approach which yields the greatest 
impact on perforraartce. 

PROGRESS : 
I — I 



Since the project was funded on July 1, 1976, the following tasks ffeve been 
completed: 

!)■ Developmerjt of Sample Alqoritto 

' Cardiac algorithms designed to address eight arrhythmias have been 
developed by local staff and reviewed by a panel of, national 
consultants. 

•2) Development of Data Validity Prpeedures 

Several methods were developed to assess fi el performance; the 
■forms are described under Task #3 ^)elow. 

( * 

* 3) Development of Xardiac Alqoritfan Forms 
•» '. ' 

In developing the cardiac algorithm set, several data collection 
instri^nents were developed: a treatment checklist form completed 
sequentially by EHT's;||tandard run report form completed by 
Ehrr's;-and sequential ffeatment procedures as reported by EMT's 
completed by physicians at the b^se hospital. 
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4) Pilot Test and Cellection of Baseline Data 

A two-month pilot t4st with four I^tobile Intensive Care Units 
{HICU*s) ,to conectn)a5eli.ne data was coniplSted. 
^ 

5-) Development of CompTliance Heasurement Model 

Several discussions with personnel at the ^National Board of 
Medical Examiners and other cons'ultants provided plans fot 
quantifylr>g cases tdward the development of a. compliance model. 

6) . Assessment, and Rey^^pn of Algorithm 

The algorithm set was revised based upog two na'tional surveys. 

In addition to the above tasks, a literature review of the management* of 
cardiac emergenc4es was complete<d and annotated abstracts developed. 

Tv/o major B'tS system changes Mve occijred as a result of this project: 1} 
JEHT's are now required to call/'^nto a base, hospital to communicate 'with* 
physicians regarding cases involving defibrillation or the administration of 
drugs; and 2) ? proposal has been made by the Fire Depar*tJnent to i/pgrade all 
fire rescue units (EMT-I) to the MICU (Ef^-II) level through extensive 
tra^ining and refresher training courses. ^ 

DISSEMlMTION OF RE$£ARCH RESULTS : . ' 

L. Colt, J. Sims, S. Otterbein, R;' Starorcik, and J. Morganroth. "Clinical- 
ATgorithfhs: An Improved Technique for EMT Performance Assessment," to be 
presented at the American Public Health Association lOSth Annual Meeting 1977 

L, Cole, J, Sims, R.^ Sta^oscik, «). Horganrcth «nd 6. Cayten. "Pre-h6spital 
Coronary Care: The Illusion of Consensus, y to be presented at the University- 
Association for Emergency Medical Servicj^ Annual Meeting, May 1977. 

L. Cole, /'The Use of Algorithms in Evaluation of EMS Training anjl M^anpower," 
presented at National '^EMS ^va^jation, Symposium, New Orleans, January 1977. 

Cited in Emergency Care News , "Adv£^noed/Basic Care Among $4 Million Research 
Targets," No vember-r December 1(12):1 , 1976. 
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SIGNIFICANCE: 



"Perhaps the i^st effective procedure: which should be carried out by 
emergency medica> service workers is 'cardiopulmonary- resuscitation .(CPR).' 
Victir^s of heart attacks or other emergency conditions which product, cardiac 
arrest can often be s^ved if heartland respiratory function can be maintained . 
.at a level sufficient to forestall deat^h until definitive treatment can be 
instituted. In CPR", the rescuer combines forcibje compression of the' chest 
to stimulate heart action wfth moutb-to-mouth administration of oxygen. There 

is no question that many pecSuOm. nwg theic^i^^Aft-^jtM^r-ege^ttfer-^^*?^ 

is presently performed.' It is likely, however, that there are ways of improving 
the procedure, or improvfng the methods by which' rescuers are trained, so that 
even more lives would be. saved. Clinical experts haye frequently observed that 
the procedure itself often produces/injuries; dag^ifle to ribs or internal organs 
is often noted. This study will attempt to shed 1^5^ upon the "complications" 
■of CPR. Such complications fall into two categories: some are considered 
preventable but othfers are not only unavoidable but necessary, since they 
provide evidence that .ttje CPR was administered with Sufficient vigor to 
accomplish' its purpose'.^ ' , 

PROJECT DESCRIPTION : ' ' . \ 

Working through the office of the- Medical Examiner and hospital emergency, 
services in Miami, the research, team wil 1 Identify out-of-hospital victims of 
.illness or accident who have received- CPR, including both survivors and deaths. 
A careful and systematic postmortem examination will be performed to Identify 
damage to bodily organs or tissues in non-survivars; patients, who are 
resuscitated successfully will be followed throughout their subsequent 
hospitalization. Rescuers will be contacted to determine Such characteristics ' 
/as their size and weight,_leve1 af training, experience*, and technical skills 
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in performing CPR. An-attempt will be made to relate the nature of .any 
complication detected to survival or jionsurvtval and^ to characteristics of the^ 
incident, the victim, rescuer, and the* techniques oiiployed in treatment. 
Correlations, for examp.le, between body characteristics of the rescuer' or the * 
victim and complications of a certain 'type (such'as rib fractures) may point to 
improved methods tff .carrying out the procedure. Although the, conclusions that 
can be drawn vTill be limited, a partieiriar. type of 'injury vrtiich found 
Trequently in the nonsurvivors but not in sur^/ivbrs-TOr the reversie--will 
provide ijnportant suggestive evidence pointing to ways to improve t'he 
effectiveness of CPR, and. reduce its, negative consequences. * 

PfjOGRES^ f . . - . ' ' . ' 

.The project has develo|5ed it$ administrative structure and has begun VeCruit- 
men t and other ors^niz&tional activities on site. Data collection is expected 
to begin in early Falll 1977. ' ^ . , • 

DISSEMINATION OF RESEARCH RESULTS : . \ ' 

~ ^ T - ^ , : ' ' 

In addition to pr^sentat^oiYs at professional and scientific meetings and^ 
journal articles,, a semir^r is planned one month. prior to the enjl of the 
project.- Representatives of national agencies with CPR training 
responsibilities will be invited, as well as researchers in relevant 
clinical areas, to review study findings and recommendations for changes 
in policy and practice. . . 
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SIGNIFICANCE : - . • ' 

The practice of modern medicine is becoming increasingly dependent upon the . 
interpretation of the vast quantity of data that is now available to the 
physician. In order to successfully utilize these data the information 

--must be presented to the physician in a timely manner and, a concise and 
orderly format. The physician must. then be able to relate this information 
to, the patient's major problem as well as to other disease processes. 
Nowhere is this problem more acute than in the treatment of critically ill 
patients. Iri these. patients, not only is the nature of the problem often 

.:.-espj.cially._QfljijpJ_eK^.jM problem^f dat-a - - — - 

1'nterpretation, but the consequence of inadequate manag^ent may be death. 
The application of modern data processing techniques is an obvious approach 
to providing aid to the physician in the treatment of these patients, 

» . 

To meet these needs a computer programming system known as the Clinical 
Assessment Research and Education (CAR^) system has been developed by this 
research team under a grant supported by the National Center for Heal-th 
Services Research. Jt is designed to be used in critical care "areas, such 
as inteftsWe care units, by physicians, nurses, and paramedical" 
pers(?nnel. Primarily, the CARE system is a consultative aid not only for ' 

■■ sur^icil patients, who often present the most complicated .metabol ic 
considerations, and difficult recovery courses, but also for many acute 
medical "problems. 'The system alsb relates these important problems to the 
most recent- literature as a "living textbook", and permits the physi'cian 
to ga>n -information frx)m, and communicate with, other members of trie health 

- care- tesffi. It has been implemented through a nationwide 'time-shared 
computer service so as to allow wide-spread and easy access to this type 
of patient care assi^stance. • ' • * 
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TheT:ARE system offers a means of ensuring that tlie physician faced with a 
life-threatening surgical or medical problem need not rely only upon 
individual memory and knowledge in order, to brin^ to that patfeTrP^he best 
that the current state-of-the-art of medicine has to offer. • 

. PROJECT DESCRIPTION : ^ . ' ^ . 

The CARE system wa^ designed to operate in a time sharing onode to permit 
use of the .system tn manj' critical care areas without inordinate cost.. 
The tinie sharing facility used has a nationwide network of cormunications 
servicing the majority' of major cities. In order to meet >the demaTWs of 
medical users the computer system is operational 7 days a 'week for an 
average of 18 to 20 hours per day. /\ ' 

The advantages of a time sharing system to the hospital users are many. 
No^'large capital equipment expenditures are required. The CARE system 
' requires only ja visual display terminal, a harti copj* printer and a telephc 
or acoustic coupler. Once the terminal is installed it takes onl^y^^j, few 
minutes to, validate a^^new user. There is no minimum charge for service; 
the user pays only for. the time actually on the system. It shoiTTd 4)e' 
emphasized that, due to' the design of <the CARE system, little or no 
technical knowledge of computers is required by the users. The CARE 
sy£ten>is a consultative aid that is readily available at almost any 
geographical location in the continental United States, regardless of 
whether the user is ii)»,a small 150'bed community hospital or a large 
metropolitan medical center. 

The expanded CARE system is comprised of^o.ver 150 individual inter- 
"related programs arranged into a logical overlay structure. This overlay 
"billows only those progre^ms necessary for the immediate task to be held in 
the cor&. memory of the machine at any one time., thereby^ reducing machine 
overhead\ The programs^are divided into 4^asit groups: 

1) system control - these are all the programs internal to the 
CARE system that provide the proper data^ manipulation, 
program manipulation and system maintenance. 

N . 

2) input - these programs control the input of data to the system. 
The input is divided into 22 categories, each cafegorj 
representing s|)ecif1c related information. ' 

3) Computa^n and output. - these two groups are linked together 

• . since the output routines are dependent upon the computational 
routine^. Whenever an output is required the .associated 
computational routines are involved tonsure that th^- output 
represents the latest data eritered, suct as corrections or 
updated laboratory; findings. 

When a patjent has been discharged. the total record for his stay' is 
permanently stored on magnetic tape.' A complex- systefh of "keys"' 



restricts access to the system in order to pr*otect patient privacy. 
• (J? 
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When the- responsible physician recognizes that the managemjgnt of* a 
particular patient will be difficult, he may choose to seek consultative 
aid* through the CARE system. The system now affers therapeutic guidelines 
for 28 major problem areas. The first step for the physician in obtaining 
the'se, guidelines is to- enter an initial assessm^t for the patient. Tiw 
physician is then interrogated by the system for basic descriptors of the 
patient; name, 'hospital nurjber, age, sex, racfe, weight, height/ejc. 
The major problem that is manifested by the criticaUy i>l or injured 
patiefrtrTi then identified by the physician. Depending on the problem . 
selected, -the computer next' queries the physician for more details. For 
Instance, if the major problem. is trauma, questions eliciting the exact 
nature of the injury are .asked. 

If the major problem. happens* to be one of thfe three general categories of 
postoperative stress, a series of questions is asked to elucidate the 
exact nature of the surgical procedure. Information is also requested^ 
defining the patient's physiplogical status. Vital signs at admission 
(blood pressure, heart rate, respirations), mentation, nature and location 
of pain,^ECG findings* sepsis, expected and. present hematocrit, etc., are 
examples of some of the information elicited. Questions are asked ' 
concerning the presence of other concurrent disease processes, cardiac 
and non-cardiac, that may influence fluid and electrolyte requirements^ 
for^the patient in the immediate postoperative op post-injury period. 
The physician is asked to enter the amount of acute losses, either 
measured or estimated, as well as the amount, of replacement given since 
the onse.t of the acute episo'de'. Arfy laboratory data^that is available. 
at the time oriCU admission also ma>;^ en^fered. 

The purpose of this detailed initial assessment is, twofold. First, it 
forces the physicians to consider, in all aspects the interrelated 
processes that can make difficult the management of the high risk or other 
acutely ill patient. Secondly^ this information is osed not only in 
preparing a detailed patient history but also in computiag reasonable 
^estimates of fluid and' electrolyte requirements, a major problem ia , 
managing 4)igh risk and seriously ill patients due to their impaire/ 
cardiorespiratory function. ^ 

PROGRESS : 

In the two.years of effort devoted to implementation pf the computer based 
Clinical Assessment, Research, and Education System .(CARE) .iff t&e care of 
the critix:ally ill patient the following objectives have been achieved: 

'1) The basic CARE system has been fully implemented on a national 
time shared commercial service and is now available for use by - 
physicians, nurses, and paramedical per-sonnel on a dial-up , 

• ' basis. ^ . 

a.) Use of the system requires only a data phone or 
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regular pjione plus digital acoustic coupler, a CRT. 
digital terminal, for data en^y and retrieval, and 
an impact or thermal printer for hardcopy records 
/ * when desired. No extensive computer hardware and 

tIo computer knowledge is required by the user. 

b.) The current estimated user coits are between* $250 

and $290 per mpnth rental for equipment (depending ^ 
on the'type of printer), phone^ charges to the 
/ nearest McAuto -WA'fS 1 ine, and between $15 and $30 
per day per patienvfiaanaged using the CARE system. 
This latter variability is dependent on the extent 
X of the system capability used for a given critically 

^^ ill patient* s caro^" 

2) ih^ CARE system presently includes advice for cardiovascular 
stCJ^igs, metabolic balance including fluid intake and output, 
InitiaT^ssessment modules, includfrtg the burn module, and 
daily fluid ahd electrolyte management recommendations. 

3) The phase of medical debugging, checking the medical logic 

and recommendations against real life situations, is completed." 
• ^ However, it is expected that. ongoing tailoring and revision of 
the medical information, logic, and recommendations 9fi1J be * - 
necessary as long as the system is used for patient care, since 
new advances are being made in knowTBtfge and therapy ^nd certain 
unique problem interactions will always occurs 

4) A drug information-drug caution module has been created as part ' 
tff the CARE systOT and presently contains 50 detailed one page 
cautjons* A total of 60 such cautions on major intensive care 
drugs will be available' and kept updated. 

5) Preliminary statistical information has been gathered oonc^rn^ing 
nursing personnel attitudes to computer implemetntatlon (prior 

to implementation). The ability to alter the pre-implementation 
attitudes of nursing personnel as a result of comprehensive ICU 
^ topic inservice has been evaluated as a base line for later 
^' '-^statvstics after nursing computer use is established. Tf\ese 
'have teen used in redesigning the user format for the 
POP . 11/45 conversion. 



DISSEMINATION OF RESEARCH RESULTS : 

U Computer based CARE of the aged or high risk patient: ' Automated 
assistance In fluid management, metabolic balance, cardiopulmonary 

- regulatiolT Siegel, J.H?, and Fichthorn, J.D. In: Book - "Surjgery 
of the Aged and High Risk Surgical Patientj Medical Surgi,cal and 
Anesthetic Mangement" by - Siegel, J. H. and Chodoff, P. Grune and 
Stratton. . - 
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2. Computer based comf^ultati on in the care of the critically ill . 

■ Sieciel, J.H., Ftetfthorn, J.D. , Monteferrante, J. , Moody, E., Box, N., 
and Nolan, C. Presented at American College of Surgeons meeting, 
Miami Beach, Florida., October 21-24, 1974. 

3. Cftmputer based consOltatiorr -of the critically ill patient , 
nchthorn, J.D., Hontffe.rrante, J., Siege! , 'O.H., Cairns, D.,'' 
Loggia.T., and Glfclcstein, E. Presented at the "Associat1t)n for the ^ 
advancement of medical instrumentation" meeting, Boston, Massachusetts. 
March 19, 1975. -. i . 

Abstt'act published la Medical Instrumentat^on (AAMI), Vol. 9: No.l. 
pp. 66, Jan. - Teb.-, 1975., ' , 

4- Computer based consul tatTon ^ CARE of the critically ill patient . 
Siegel, J.H. ,, Fichthorn, J., Monteferrante; J., Moody, E., Bos, N. , 
Nolan, C, and Ardr-ey, R.: Surgery, 1976 
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SIGNIFICANCE : , * - ' 

^This^rbject represents a natural extension of the work in Emergency 
Medical Systems research that has been carried out^t thfeT University of 
Pittsburgh during'the last six years. At the project's outset, it became 
clear that emergency medicine was relegated to a minor role within most 
hospitals, that amt>ulance providers were just beginning to recognize a 
need for more than first a'id training and that the public h^d no concept 
of what the capabilities o/rthe emergency medical system really were. In 
consonance with the state'of the system, data, if they were collected at 
all, were inadequate; even where relatively good records were maintained, 
data were virtually unretrievable. . * ^ 

In response to the lack^of available data and recognizing the rapid change 
that was taking place in emergency care, this research team's ^rategy was 
t(^ develop meaningful data resources which would be useful' for research and^ 
alsd effective for management purposes. At the same time, research 
activities v/ere oriented toward system elements which were less data-int?nsfve 
or for which data could be specifically and economically obtained. Major 
efforts have been completed in categorization, the ambulatory care-emerg'ency 
care Int&rface, community dynamics studies, demand estimation, vehicle require- 
ipent and location, evaluation of the effect iverless of upgrading tt>e system 
for coronary care patients, ana, the work upon which the current/^oject Is 
based, computerized evaTuation of prehospital' emergency care performance-. 

This latter study and some of the investigators' other recent aclivities 
have been possible because of the rich data resources whtch are, now available 
and w4n continue tjj be developed as part pf their excellent relationship 



26 



31 



ERIC 



I Harvey Wolfe, Ph.D.- 



with the Emergency Medical Services Institute., the^^gency covering the 12 
coanties of southwestern Pennsylvanti^ which is supportell undfer Section 1203 
of tjie EMSS Act. The ambulance data system now processes over 80,000 trips 

' per year and is still expanding. The Emergency Department da*ta syst^n which 
has been supported by the Commonwealth of Pennsylvania^ Is being^ installed 
in six Western ^^ennsylvahia,*hospitals two city, two s.uburban and two 
rural. With these data systems available, it wilVbe possible to respond to > 
the critical need for developing evaluation mechanisms for each component 

.of the emergency care system - prehospital, emergency department and inpatient. 

The objective of this pVoposalo's to develop a computerized metrology for 
evaluating emergency medical care performance^ This specifically includes 
the updating of existing models for evaluating Emergency Medical Technician 
perfortnance and also testijig the usefulness of acceptance sampling as^ 
meghanism for monitoring this perfonnance. In addition, the study wvil be 
structured for futur^ extension of this methodology into the^Emergency 
"Department, part of the EMS system with much larger voliffnes than individual 
ambula/ice providers and for which rvo good mechanism exists fof evaluating 
tlie care that takes place. \ 




ERLC 



region is the City of Pittsburgh ...... „. w..a.uwv^. .^w^ «, 

a large metropolitan centeY-."' Substantial portions of the population live 
in suburban areas and at least half of the counties in this project are 
predominantly rural. As" a resHlt, perforrtiance evali/ation will be developed 
in each of these settings and tested to det^ine the extent of transferability, 
^ . . . ./^ . 

Irt southwestern Pennsylvania, a combination of funds from the Highway Safety 
and EMSS Act$ in addition to State support has resulted in the development of 
an EMS system after over ten years of planning and politics. Since. 1972, over 
4,200 individuals have been trained at the EMT I level (81 hour course) and ' 
over 540 at the EMT . IT level (120" hour course), k methodology for the . 
categorization of different Hospittal clintcal capabilities has been developed 
by the Health Operations Research Group of the Onfverstty of Pittsbt«»gh and 
is being implanented by the Emergency Kedical Services ^Institute, the local 
EMS planning agency, and by the Emergency Medi-caT Services' Operations -Center, 
part of the University Health Center" of Pittsburgh responsible for medical 
command, consultation, education and evaluation throughout, the 12 county 
region. • " ' . , ' 

However, the evaluation of both prehospital and emergency depefrtment care 
throughout-the country has been extremely' limited, particularly when such 
evaluations must be'placed within a regional context. An attempt to have 
EMSS Act grantees provide for their own indep^ent ^valuations la^t year 
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'proved unsatisfactory. As a' result, independent evaluations were replaced 
this year by a requirement to complete an Evaluation' Workbootf for EMS 
{developed' by Arthur Youn'^ and Company under a cofitract from the Division of 

^Emergency Medical Servrices, DHEW). A recent Natix)nal EMS Evaluation 
Symposium (New Orleans, January, 1977) provided clear evidence of the lack 
of satisfactory, nationally acceptable methods of evaluation. , While there 
were many g6od Ideas relative to conducting evaluations of EMS systems 
presented at the New Orleans symposium, in almost every case the evaluators 
were severely -handicapped by t-he lack of a solid data base. 

Prehospital care evaluations, where they Rave existed^ have typically been 
fn the form of case reviews by the ambulance compaiiy's medical director, , 
Whi^l^e^ease reviews are important, the time required, the lack of explicit 
review criteria,, and the absence of a uniform method, of transmitting the 
results of these reviews to those responsibVe for providing emergency medical 
services, makes such reviews inadequate for evaluating regional EHS^ systems and 
initiating" necessary changes in areawide training programs.- .To do this, the 
strengths and weaknesses of each, provider must be assessed and their 
deficiencies and needs determined relative to their Capabilities and their 
role in the regional EMS system. 

Such an evaluation is a massive undertaking. Jn southwe$.tern Pennsylvania, 
there are over 400 providers of ambulance services. However, therdevelop- 
ment of a computerized method of evaluatioQ in combination' withr a uniform 
data system co*iipatible .with protocols for ambulance personnel performance 
permits a reduction 4n the number of cases that must be reviewed by a 
physician with minimal decrease in the effectiveness and a possible 
increase, in th^ comprehensiveness of the review. Moreover, by developing 
sampling techniques which statistically reflect the performance of the region, 
evaluations c^n be accomplished as a relativeJy .inexpensive by-product of » 
uniform data systejns. ' ^ 

The purpose. of a computerized ^ergency medical services evaluation and 
review methodology is to identify .inadequacies in the femgrgency care delivery 
system. It is oriented towards ,sys tens assessment and management- This 
methodology will enable medical directors/ to identify cases reflecting poor 
quality care and aid* planners in the specification of tlraining programs and 
the upgrading of equipment and other resources within the region. 

PROJECT DESCRIPTION : 

The key to computerized regional evaluation is an accurate, detailed, protocol- 
compatibly data system. Such a data system exists in southwestern Pennsylvania 
for ambulance providers. A second systeijis under development for Emergency 
Departments and will be compatible with pe ambulance data system. From these 
systems it will be possible to deve lep pr otocols for identifying inadequate • 
care and to use uie protocols to isolaTerhe reasons for^^such inadequacies. 
For example, protocols are being developed to prescribe the actions which 
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should be taken by Emergency- Medical Technicians in the field. A detailed 
record of EMT response is currently r^eported in the standardized ambulance 
trip report. Matching* protocols to records will yield indjces for severity, 
risk and quality. Tabulations of quality scores relative to severity and 
risk will provide an "evaluation of ,EMT performance during the tin^ periojd 
reviewed; 

On a regional basis, when care of inadequate quality is observed fol a 
particular diagnostic/complaint type, the par1;icular deficiencies can' be 
alleviated through changes in the training and recertification process^ The 
number of cases which must be reviewed to identify inadequacies is considerably 
less than^ the total nisnber of cases avai lable through the data system'. As a 
result, acceptance sampling fxlai^s will be developed which will provide 
sufficient regional information to direct the allocation of training ahd 
equipment resources. ^ 

In addition, the acceptance' plans will also be, used to monitor individual 
providers/in concert with local medical directors. Specific cases will be 
identified as inadequate ^ith the care ranked according to the quality score. 
These cases will then be reviewed by the ambulance provider's medical director 
with the objective of isolating the weaknesses: • These sailing plans will be 
modelled after those used in the military with varying perben^ges of review 
required, based upon the levej^'of the quality score. ' ' 

Given this conceptualization as a rational'method of evaluating and ^ • 
^monitoring EMT performance, it is the purpose of this project to test 
the^'effectiveness of computerized review relative to peer review. of cases ♦ 
by physicians. Appropriate care typically has been determined by a 
consensus of qualified practitioners. Therefore, peer review becomes the 
standard against which any computerized methodology must be tested. If the 
\ n«w technique is at least as effective as physician review in identifying 
\ inadequacies, then an evaluation mechanism will have been developed which 
^is several orders of magnitud^e (?50 cases per minute compared to three per 
hour) less time consuming arid more comprehensive. 

The peer review approach will be pursued by the American College of 
Emergency Physicians under a subcontract. While there is justification for 
. judging a case by either local or national standards', there are two important 
^ reasons for utilizing the national group. First, an adequate number of E.R. 
physicians qualified to serve on a review panel is often not readily 
available within a single locality. Second, the ACER physicians doing the 
review will, not have to compromise their . objectivity since they will not be 
involved personally with any of the cases, institutions- or professionals. 

Although one goal of this project is to'det^ine an acceptance sampling 
program for mon^itoring EKT' performance, it fs clearly possible to conduct ' ' 
100 percent review of the prehospital phase ©nergency care if a suitable * 
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data base exists. However, 100 percent review is questionable in light of 
cost constraints and the marginal value of the additional information that 
could be obtained. An appropriate sample could provide the important 
Valuation information needed quite accurately If a computerized data base 
did not exist, ^keypunching and reviewing every ambulance trip would be costly 
and time consuming notwithstendiftg its feasibility. Thus the sampling 
methodology will enable the 'methodology to be transferred to regions without 
computerized records systems/ 

The review mechanisms being perfected and tested during this project are 
essentially process measures. Protocols or criteria are matched to the tasks ^ 
performed to estimate both compliance and the success of a particular inter- 
vention. Although the literature clearly delineates between process and 
outcome measures, in reality process and outcome are difficult to define in 
a ct^ntinuous system. 

In evaluating the performance of Emergency Hedical Technicians, many process 
measures are possible. For example, did the EHT recognize the patient^ s 
condition properly? Were standard procedures followed? Were the treatments 
given appropriate? Were^they successfully performed? This patient inter- 
vention sequence can at some point in time be specified as an outcome measure. 
That is, was the patient brought to the emergency room alive? Was the patient 
in a stable state? Was there any improvement in th$ patient's condition from 
the time of EhfT intervention until the arrival in the Emergency Department?^ 

While it may be arguedyttl^ the effect of EKT ititervention cannot be 
known until the outcc^ of the entire ^emergency carg process is ccxnpleted, 
a midprocess measure, such as whethef the patient arrived at the emergency 
department in an i^roved state, has considerable merit in measuring EHT 
performance. MT*s perform their tasks as prescribed by some form of 
standing orders (protocols) or through radio communication with a physician. 
The EHT performance measure reflects compliance relative to carrying Dut 
these directions. If the prescribed intervention is in error^ then it 
ranains for medical researchers .to identify a more appropriate intervention. 

In siBTtnary, the overall objective of this project is to develop a computerized 
methodology for evaluating prehospitH^^care of emergency patients. The 
project specifically covers improving ^he design, validating and testing the 
effectiveness of tTie investigators* prehospital performance evaluation 
methodology. In particular the following achievements are expected during 
the two year undertaking. 

1. To appraise and modify existing EHT protocols. This will involve 
modifying existing protocols and developing some additional 
protocol material in order to form a set of computer compatible 
protocols matching the southwestern Pennsylvania uniform ambulance 
data systan. 
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2. To derive weights for severity, risk and quality indices and to 
make the -prehospital care model ^operational . This will incjude 
a reassessment of weights using a panel of emergency physicians. 
Then the model will be applied -in order to select cases for 
validating the model. . ' • ^ ^ 

3. To validate the efl^ectlveness of the computerized'iixideV'-fn 
correctly assessing the quality of performance of ambulance 
providers. This involves a selection of cases to be reviewed by 
an expert panel and a compariwf of quality scores with oeer 
review assessment. ' • . 

4. To design and apply quality control methodology to, seA^cting cases 
for evaluating prehospital performance. Acceptance saSp^ing plans 
win be designed and tested. ' ^ 

5. To develop a procedure for isolating specific deficiencies in EHT 
performance and incorporate this information into a feedback 



program for training purposes/ The Emergency Medical Services 
■yistitute and individual provideV-s' medical directors will rec 
Redback on provider performance so that deficiencies 'may be 
alleviated through changes in regional and local trailing pr 



receive 



ng programs. 

6. To test the effectiveness of the computerized performance evalua- 
tion. Measurements of ^he quality index for particular ranges • 
Of severity and risk of intervention will be made periodically 
Comparisons vtLLUifi made between different time periods to test 
tlie effectiveness of the ^luation program. 

7. Tq. assess the cost of implementing and operating the\prehospital 
V . -performance evaluation systems. T 

t 

PROGRESS : . 

While this i/ a newly funded project, as noted previously, it builds upon 
extens.lve work carried out by. this group over the past several years. The 
team has completed preliminary community organization work which includes 
gaining assurances of collaborSition from organizatfofis having the dat^ 
necessary to the conduct of this study. ^ 

DISSEwIaTION or RESEARCH RESULTS : " ' ^ 

Some selected relevant papers resulting from previous invesitgations supported 
by KCHSR follow. - . ' ♦ ■ 

« 

H. J. Gunter, A Comparative Study of Conrnunit/ Planning for Emergency 
Medical Services: The Impact of Social and Political Factors on 
Program Implanentation, Health Operations Research Group, University 
of Pittsburgh, P^tsburgh, Pennsylvania, July,. 1975. 
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L, Shuman> H. Wolfe and J. Sepulveda, Estimating Demand for Emergency 
Transportation, October, 1975, Health Operations Research\*6roup,' 
University of Pittsburgh, Pittsburgh, Pa. *^ 

Health Operations Research Group, Ambulance Record Coding Manual, 
University of Pittsburgh^" Pittsburgh^ Pa,«, June, 1975. 

J. A, Nachlas, Regional Planning of Critical Emergency Medical Care, 
Doctoral Dissertation, University of .Pittsburgh, PittslB'urgh, Pa., 
April, 1976. 

* ' • 

O.R. Salguero, A Categorization Approach to the Regional Allocation 
of Emergency Services, Master in Public Health Thesis, University 
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SIGNIFICANCE : 

Optimal management of medical emergencies occurring in the hospital must 
include methods of early detection. A computer-based system has been 
developed for hospital-wide monitoring which, according to fixed protocals, 
gathers physiologic and clinical data on patients and from these data ' 
recognizes patterns indicating a threat to life. These patterns identify 
the patient who may need the mor§ intensive monitoring and special care 
provided by an Intensive Care Unit, thereby preventing late, "doomsday" 
approaches to the care of such patients caused by delays in recognizing the 
gravity of their condition. . , 

Care of the acutely^ill patient places requii;^ents oft-the practice of 
medicine whicKare demanding of both time and inteVTect. Using protocols' . 
to assist in patiant care will reduce the delays' in^ rejponding to the 
moment-to-moment changes in critically ill hospitalized patients, and will 
also provide betters, methods of monitoring and treating such patients from 
the time they enter the emergency room throughout the course of their 
hospitalization, and especially wMle they are in the Intensive Care Unit. 

PKOJECT DESCRIPTION : ■ . . - ^ ' 

An extensive computerized medical data base has beenjiele loped over the 
past ten years from 'which medical decisions can h?^mde. This data base 
Includes clinfcal laboratory results, physiological monitoring information, 
multiphasic screening infonnai4^f^-aiid many other items such as automated 
spirometry and electrocardiography, patient's drug and allergy information, 
admitting diagnosis, vital statistic^ such as height, weight, sex, age.^nd 
certaJn historical information. Host of the data are automatically entered 
from liboratory, ICU, medical record and surgical locations. Although 
physicians record much of the data in the patieat chart, entry into the 
computer is done by paramedical professionals'. 
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As 'each piece of data is entered into the machine, it is processed by a 
decision-making system called HELP which evaluates the data according to 
protocols (fixed rules). If an "alert" (life-threatening) condition, is 
recognized the data ar§ stored in a special file for review by nurse 
clinicians.. If the data do not represent an "alert" condition, the case 
is interpreted and reported routinely. Since tlie program is still develop- 
mental, nurse clinicians follow up '"alert" patients by first reviewing the 
patient data to uncover possible errors in either data cpllection or the 
alerting logic. ^These highly trained nurses then review the patient's 
chart and visit the patient to verify the "alert" condition. If a true 
"a>§r^ condition exists, the nurse clinicians immediately inform the physician 
or fHjrsfe, record/ their subsequent actions, ^nd.then assess the benefit to the 
patient of this /early recognition. Rapid follow-up and persona-1 patient , ^ 
evaluation. raWier thpn retrospective chart review, are important featjjres of 
the prograin^nfce many times indicators of impending'compTications and critical 
situations are not recorded in the patient chart. - ^\ 

In addition to the "alert" system for monitoring hospitalized patients,' 
protocols' are being developed artd tested to improve the recognition of 
those patients first entering the ER who should be admitted to the ICU, 
and to standardize the care given in the ICLT. 

PROGRESS : . . ^ 

In the nine months that the project has be$n operational, cooperation has 
been established with other institutions in the local area in development of 
acceptable alerting criteria. Nurse' clinicians are following-up on an 
average of 54 alerts- per day, representing about Z% of hospitalized patients. 
Of these alef'ts^early half occur on patients already in the* Intensive Care 
Units. The other 30 .are new alerts, fo.r^patieiits located on general hospital 
shards. With most patients, if one alert ^^^fy6ars , another will follow within 
24 hours. In about 16% -of the cases, alerts signal patients requirj^g^J>ew" 
visits^ In only about half of- the cases being observed during the baseline 
study period, patients who are signaled as "alerts" are already being treated 
optimally according to the nurse clinicians' judgement.^ During the "post" 
phase, both compliance with the recommended course of care and the clinical 
outcome will be studied. " - 

The baseline .data suggest the following preliminary observations: 

1. The frequency with which hospitalized patients enter an "alert''' 
or life-thrgatening condition is rather small I ^ 

2. Only about'half of'tFe^alert." patients are already being optimally 
treated. . ^ ^ * • 

3. The chances of survival of about 1% of hospitalized patients might 
" ' be^ improved through this system' if/^c^B^iance by physicians and 

nurses is high. Thus, although the yield is to a relatively small 
number of ^patients,, the benefit would be very great to each one. 
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The study will also be of enormous help in .improving our ability to distinguish 
those patients who do and do not require costly ICU care, and may permit a 
. shorter^length of stay for some. . 9l 

DISSEMINATION OF RESEARCH 'RES ULTS : 

■ ■ «. 

Preliminary experimental design was described in a paper presented at the ' 
lecnnicon International Cojiaress in December of 1975 in, New York City Several 

;i^cL°:i\ 'r.5''" f ''^^ inst'itutions by members of 

the research staff, primarily by Drs'. Gardner and Clermier.'^ 
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SIGNIFICANCE ; ^ , - ' . 

The objective of this researoh is tcj^ssess the quality of EMTs (81-hduf 

5 DV 



trained EMTs) prehospital decisions oy developing and applying ^eries 
of diagnostic and/or physiological measurements obtained in the^^ which 
will at^ssin judging the quality of specific prehospital diagnostic and/or' 
- ther^j^t^t^^ by EMTs. These measurements are Called "proximal, 

con/irmatTon parameters." * • 

FourM^ditions are being stucfied; peripheral fracfiires, cardiac arrests, 
abdomina^l trauma, and suspectetl Mis. These conditiorrs^re chosen because 
they illustrate four discrete types of confirmation issues and EMT inter- 
vvenii oner which presently exist or ^ire planned in the future for each 
, c6n(^jtf^^ ^ ^ 

At this stage of Emergency Medical Services growth, objective criteria for 
assessing EMT decisionniaking^are necessary to supplement the expert, 
jK intuitive*opinions upon which present EMT guidelines are based. Pressure 
for rapidly expanding emergdtJty services and EMT, training from public, 
^ iPrivate, and governmental sectors has been counterbalanced by concerns : . 
from physician aW legislative groups about what the EMT carr and should 
do, how well ,they dp it, and ihe potential harmful as well as beneficial 
effects x)f what they do. f^w that the ejfpeoditures and time commitment 
have reached significant proportions, a methodblogy for answering thesfe 
^ que?t^ns needs to be deybloped. This study represents a first step in* 
^hafoTrection, by. establishing a clinically meaningful set of parameters 
' ^o(,evTluate specific steps In the EMT decision process. . 
J . ^ - 

This study, then,- is a methodological one.- As such, the 'sample size, the 
particular lodale, lacli^of ratiddmness in the sample, and other such concerns 
.are less rejgvatit than usual, because findings will not be focusing on the* 



3^ 



Michael W.- Pozen, M.D., Sc.D 



I- 

J 

general izability of the sample, but rather on the validity, rel iabjlity/ 
1nterna> consistency, and feasibility of the criterion measures in terms-^Qf^ 
whether they do or do not accurately measure the phenomena they were 
developed to measure. The sample and the getting are a real-life testing 
^rena through which the methodology is deve>Qped and evaluated. The 
assumf)tion,here is that once a Methodology is available', other studies oh 
other samples, by the same and by other investigators repeatedly' 
evaluate it and make changes that seem^warranted. 

PROJECT DESCRIPTION : - • ^ 

The overall steps in tt^e methodology cah^be summarized as follows: 

1." A 'description" 'bf the distribution of confirmation parameters 
relating to specific components of th^Bjiffs' decisionmaking. * 




.2, Use of these distributions by a Technicaf^ Advisory Group to 
provide a rational basis for restructur4ng EMT guidelines ^ 
for making (the specific decisions under study. 

3. Introduction of the amended guidelines into" the EMT set^of 
standard operating prqcedures. 

4. Institution of a Phase II study to assess the effectiveness 

of 'the changes in interventions based on the above methodology. . 

Although physician diagnoses are not infallible, they have been selected 
.as the- basis against which the EMTs will be judged for three reasons. 
First, these physician diagnoses are the most definitive -statement 
available of a patient's condition. Secondly, these diagnoses are made by 
/the physicians iji whose stead the EMTs are acting during the preiiospital 
phase, and there is, no reason to expect the EMTs to diagnose or treat 
patients in a manner beyal^he physician's capacity. Thirdly, the 
diagnoses of the "physicians reflect' the local acceptable level of care. 

«» 

The performance of 59 EMTs in the Boston City ftospital Ambulance Depart- , 
ment will be assessed in terms of condition recognition and/or correct 
•Intervention fc^roiflss af patients with four -sisecific "condition's. The 
research ts intended to develop a methodology for creating baseltne 
standards for judging the performance of the EMTs- by the present duties 
prescribed for* graduates of .a conventional 81-hour training program. These 
standards will then be used as a yardstick against which the performance of 
noncertified EMTs, groups of EMTs trained in various levels/settings 
and EMTs with advanced training for patient conditions (e.g., cardiac 
rescue technicians) can be compared.. The proximal' confirmation parameters 
to be developed are as follows: 

*M. For peripheral fractures, false positive and false negative 

rates of splinting fractures will be calculated. The ER physiciaa 
with x-ray will provide the true diagnosis of fracture or no 
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fracture and the EMTs' recognition of a potential fracture and 
application of the splint woul8 be compared with the true 
. ^situation, thus 9enerating false negative and false postti-ve rates 
for each EHT. ^ ^ 

✓ * 

2. The pH of arterial blood as a measure for the effectiveness of 
CPR. CPR^ is applied by EMTs in cases of cardiac arrest. The 
rationale for using arterial pH as a proxy measure 'of the 
adequacy of the intervention (CPR) is that, controlling for 
duration of the arrest, CPR should result in a reduction 4n 
acidosis and therefore a more nearly normal blood pH. level. 

For patients with abdominal trauma-, the number of units of 
fluid, replaced in the first hour after arrival at the ER. This 
proxy measure will be correlated with rates of change in blood 
pressure, pulse rate and Double Product, whi<:h is blood pressure 
times pulse rate. ' Rates of change per unit'time will be measured 
from the time the patient is first se|n by the EMT untril the 
patient is first seen by the ER physician. Two categories 0/ 
abdominal trauma will be studied • solid organ or ya^tiiar^ and 
visceral. It should be noted that currently EMTs ar^^pa^ 
only to bandage abdominal Injuries^; they do not start TVs en 
route to the -hospital . The outcome being measured at present 
is essential ly\an outcome without the benefit of intervention. . 
Baseline data will describe the "Natural History" of abdominal 
traiOTa prior to treatment ii> the ER, and measures continued 
over time after ttfie ER treatment begins will permit measurement 
of EMT performance when, in the future, they are pennitte9 to 
perform IV*s. 

-4. False negative rates for each of ten symptoms associated with 
heart attacks will be used as proxy outcomes for patients with 
"suspect" HI. It should be noted that these symptofns represent 
"diagnostic outcomes" for, EMT performance in the sense that 
specific therapeutic interventions are not being tested. 

The study population will be patients with the four conditions identified 
above, transported by the department of Health and Hospitals* ambulances 
during a 2-year period and treated by the 59 EMTs employed by that Depart- 
jnent. All EMTs have had the national 81-hour EMT course and passed the 
national registry exam. A centralized ambulance service has been developed 
under the Boston City Department of Health and Hospitals (DHH). PreseF>t?3y 
the City has seven ambulances stationed at key locations in the City witlK 
three back-up vehicles at Boston City Hospital. The nimiber of ambulance \ 
runs and transports has doubled within the last 4 years and the .upward 
trepd is expected to continue. Percentage of emergency calls in the City 
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• of Boston to which ttfe DHH responds is greater than 50 percent and it is 
projected that by f4.sc^>^ear 1977-78-, DHH will considerably phase out ^ 
police and private' amoulance services.- fin effective conmunicatjon system 
"Tias been established and is located in the Boston Police Department Gomnunica- 
tlons Center. The ambulance communication 'personnel are physical Ty located 
in the Radio Dispatch Room in close proximity to the Sixth- tlistrkt Police 
Dispatchers. The Police Department has been -developing a computer assisted 
dispatch system wftich is programmed to include use by DHH personnel for 
dispatching ambul-ances; 

^ The estimated number of patients in each category to be transported to the 
ER over the 2-year period is: cardiac symptoms 2,470, cardiac arrests 260, 
abdominal trauma. 312, and suspected peripheral fractures 728 resulting'ln 
a. total of 3,770 cases. . , ... 

Data collection y1 11 take place by jlaily retrospective recor3'''review on 
each.s1iydy patient. Record sources will include the EMT Ambulance-Service 
Report^and the Boston City Hospital Admitting Department records. Thus, 
prehospital ization data or-£MT diagnosis and treatment will be obtained and 
the admitting records will-prpvide sociodemographi^ data, past medical 
history, clinical course, length of hospital stay, "final diagnosis, and ' 
outcomes. . *^ ~X 

An evaluation of EMT perfortnance on the basis of false negative and false 
positive .rates for the' vari^usidlasures will be performed. The major 
variable of Interest pertai^flng'to theEMT-is length of experience. This 
analysis pertains tej^^eri^eral^ fractures and suspected Mis. 

Changes in physiologic sjfcatTes ov6r time - blood pressure, pulse rate and ^ 
Double Product - will be •cgmpu.tefl for abdominal -trauma patients. For 
cardiac arrest patients ^-3:1:^^31 categorized by length of time 
arrested will be plotted^b^^,l^s±-squares fitted .curve. 

The research repres?nts thp init1>r development of a practicable' 
methodology for'fssessina €MT decisionmaking. Such an Initial effort is 
necessarily -based on certain assumptions. It requires the study 6f-'a 
limited number of conditions .and the use of aroup measul-aiients in lieu of 
individual patient outcomes. Furthermore, the practical nature of the " 
methodology presu^jposes the availaW^ty'of other groups of EMTs so that 
the continually increasing sp|ih1s1*fcat1on ,of their clinicaMnterVention . 
training can be cortipar^d with -the baseline me.asurfements being developed 
, in thii study.. Ultimate Ijr g^e utility of these confirmation parameters ' 
will br assessed -in terms of harder outcome .measures such as mortality. . < 
length of hospital ^stay, and residual disability. . 

The use of ER confirmation parameters for EMT decisionmaking differs - 
significantly -from, the more coninon use of specified patient outcomes " 
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(i.e., mortality rates) to assess the effectiveness of a pre-determinedV 
EMT intervention-. In most.medlcal research, interventions are detemrtne^i^ 
by experts and subsequently subjected to 'trials whgrein the differences 
in*"*outcomes are assumed to b£ related to the new intervention. This 
model has four advantages over the traditional one; 

1. Proximal confirmation parameters relate tp specific steps in the 
EMT, decisionmaking process and are not only based upon outcomes 
. as in the traditional model. 

^ Proximal ^confirmation parameters provide criteria for judging 

EMT decisions- inTBediately upon arrival in the ER and eliminate 
the confourtding variables inherent in traditional outcomes, q 
i.e., the effects of type of hospital, availability of hospital 
personnel and equipment on the ultimate outcome of the 
intervention. 

3. Proximal confirmation parameters, -by providing information on 
the specific EMT decisions, can be used to develop improved 
guidelines for nsaking these decisions. Traditional outccnnes 

^ only describe the new process interventions as effective or 
\ , ineffective. 

4. Proximal confirmation parameters for cardiac arrest and for 
abdominal, trauma provide physiological data for improving 
decisionmaking as opposed to providing purely statistical data 
based on outcomes. 

' PROGRESS : 

The research team has carried out a preliminary ambulance survey from 
which estimates were made of expected, numbers of car(ffac arrests and 
impending Mis to be captured in the study. Collaborative arrang^ents 
have been established with the Office of Emergency Medical Services of 
, the Commonwealth of Massachusetts and with the City of ^ston Ambulance 
Service.^ 

DISSEMINATION OF RES^CH RESULTS : 

^ As the study orogresses, presentations at scientific meetings can be 
expected as We-lTi as journal articles. The final report will be made 
available, to the public. 
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SIGNIFICANCE : 

An important t^hrust in the developinent of emergency medical services 
systans throughout the ^country has been the establishment of regionalized 
systegis of transportation, communications, and treatment facilities to 
permit the handling -of critically-ill patients in the most effective and 
. efficient manner. Patients suffering severe burns, for example, would be 
resuscitated to a stable condition locally ahd then transported to a 
designated critical-c^re center,- staffed and equipped to provide definitive 
burn care of a sophisticated nature. A well-publicized model for these 
systems has been the Illinois Regional Trauma System. 

This project evaluates the performance of the Illinois Regional Trauma 
System by comparing various aspects of the care received by patients treated 
Within the system with* that received by equivalent patients treated at 
hospitals outside the system. The results will be useful in evaluating the 
extent to which organized systems can improve the -quality of care for ' 
Vritically-ill patients, and whether this care is provided effictently. 
-• Findings from this research should be particularly important to rural 
communities, for if they perform as expected, such systems of regionalized 
care have the potential of ensuring prompt care of the highest level when it 
is required, without plating upon each community the economic burden of 
supporting specialized facilities of the degree of sophistication -required 
to treat the most difficult cases. 

DESCF^PTION OF THE PROJECT : 

The population for study is all cases of eighteen cat^r its of trauma, 
graded .according to three levels of severity, hospitalized during the year 
July 1, 1973 through June 30, 1974-. That year was the final one during 
. which the Illinois Trauma Registry collected data on all cases of traima ■ 
treated in the 50-hospital regionalized trauma system. The validity of the 
fJata from that system will first be tested by drawing a 10 percent sample 
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of cases from the records of the fifty hospitals and coinparing^|;h©n with the 
registry to identify case omissions and to determine the completeness yid 
accuracy of the registry data; in addition, a 10 percent sample of registry 
cases will be drawn and compared with the hospital record. A sample of 
200 cases in each trauma category from the registry will then be compared 
with a matched sample of similar cases treated in hospitals not 'desigjjated' ' 
as tnauma canters by the State Health Department. Outdome date s^^roas 
survival, length of hospitalization, residual impairment! patierix satisfaction 
and cost will be obtained from the registry, from hospitah records, and from 
foll6w-up questionnaires^ 

PROGRESS : 

In the first eighteen^ iiK)nths of the project, the two-way validation has^ 
progressed through the data collection phase. Preliminary analyses have been 
conducted to determine differences between expecte^ and actual frequencies 
of cases reported, In order to target more directly the record-search 
activities. , 

Data forms and procedures for the case-control study have been developed, 
and hospital and registry data collection and organization are nearing 
completion. All trai^ registry d^ita are coded. and keypunched, and 
protocols and computer programs for analysis have been constructed. 

DISSEHIfiATION OF RESEARCH RESULTS : 

Manuscripts are in preparation on {a) the construction of a new technique 
to grade injurj^ severity retrospectively, (b) the use of "tracer" conditions 
for evaluative studies in emergency medical services, and (c) a description 
"Of the mfethods of the case-control study. - 
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SIGNIFICAfjCE" : 

The Disaster Research Center (DRC) is conducting a systenatic and cocnparative 
study of the delivery of ©nergency medical services (EKS) in large-scale and 
relatively sudden disasters in the United States. The objective of the 
^research is (1) to establish by empirical study the characterfstics of the 
programs to provide -EMS in mass emergencies and C2j to Ascertain- the general, 
conditions^^^pr^actors which affect att^pts to deiTfer services in such 
crisis situations with many victims. The findings will have -Important implica- 
tions for general EMS training and education and will syggest guidelines for 
the planning of the organization and delivery of disaster-related £HS.^ 

Ev^n.the preliminary analysis and observations indicate that disaster- re la ted 
EMS planning is inadequate, that planners for these kinds of EMS activities 
have no systematically-derived body of knowledge upon which to draw, and that 
EMS responses in disasters ^re only occasionally effective and seldoo efficient 
It is also apparent that there are widespread misconceptions among D-iS and 
related personnel about human and organizational actions in disasters, that 
the current structure and attitudes in the* EKS sector make it very difficult 
to learn from disaster experiences, and that the existence of an EMS system 
at a time of disasters is often a myth rather than a reality. On the other- 
hand, most of the disaster-related problems in the EMS area appear solvable by 
selective system redesigning and organizational planning. These solutions ^ 
would not require major financial expenditures, massive reorganization or the 
creation of a new technology. 

PROJECT DESCRIPTION : . ' 

^^^^^^^^^^^^^^^^^^^^^^^^^ jtf 

During the past two years, DRC has conducted field studies of twenty-eight mass 
emergencies in twenty-two communities, spanning fourteen states, the District 
of Colunb^^^iT^d' the U.S. Virgin Islands. Field research has consisted of 
three kinds of studies: the baseline or Tin^e One studies used to gain informa- 
tion on EFB disaster planning and normal^^S operations in six disaster-prone 
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U.S. communities; on-the-spot researcf\ of five pre-planned events where the 
possibility of excessive casualties was anticipated; and studies of Tinve Two 
operations, or the EMS response in twenty-three mass casualty events. Included 
in this Jast category were both natural disasters (seven events) and technological 
(jlisasters (sixteen events). ^^^aster agents included five tornadoes, two floods, 
^ eight transportation accidents, one major fire, and seven explosions and toxic 
leaks. Often, more than one trip was made to a community by DRC personnel, so 
that knowledge could be gained concerning EKS operations in pre-, trans-, and 
post-disaster settings. 

DRC's focus on gathering comparative data on sudden mass casualty-producing 
events, together with its use of the interorganizational , open-systems theoretical 
model, dictated a research strategy that was both distinctive and apjSropriate. 
Essentially, three things were required. First, multiple case studies exhibiting 
a variety of system" characteristics were needed. Studies were undertaken in 
communities as small as 5,000 as well as in several major American cities. 
CcCTHunities at all phases of EKS develofxi^nt, from tnose with only the most 
rudimentary capability ta those with sophisticated systems, were included in the 
research. Second, field teams had to be present on the scene as soon as 
possible after a mass casualty incident. DRC's mode of organization ?tade this 
task possible. Ofterr, field personnel arrived on-site within a few hours after 
» disaster impact and were, therefore, able to obtain imn^ediate accounts of the 
activities of D^S organizations, in preplanned events, such as Kardi Gras, 
teams of researchers were on hand before and during the event. Third, in orde^r 
to understand syst^ organization and functioning, it was necessary to have 
contact with key DdS officials and operational personnel in a variety of em^gency 
health care organizations. In-depth, open-ended interviews were conducted with 
hospital admin^istrators; hospital personnel responsible for disaster planning; 
physicians, nurses and other medical staff; providers of ambulance and other 
transportation services^ persons involved in normal and disaster EKS caimunica- 
tions; providers of emergency first aid; and others responsible for EJ4S tasks 
in disasters. 

Approximately 515 intervie??s were conducted in the course of this research, and 
there were perhaps twice that oumber of informal contacts with personnel of 
Bner^ncy organizations. Additionally, extensive documentary data (e.g., from 
' eJBergency departn^nt logs, newspapers, and disaster plans) were obtained, and 
thousands of of observation were perfonr^d. 

Observational tjata, obtained on-site by-DRC field personnel, was invaluable al 
source of information about the reliability and validity of data obtained by 
other means as well as information about the reality as opposed to the ideal 
of EKS delivery in high-demand situations. 

PROGRESS : 

Analysis of DRC data suggests the following major conclusions: 

1. Few comnHjnity health-care systans have undertaken realistic overall 
•planfTing for handling large numbers of casual* 
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2. Most B4S planning and operational personnel mistakenly assume that the 
everyday EMS system can be extended in mass emergencies and that a 
•system which functions adequately during normal times will also do 'so 
. in disasters. 



/ 



3. There 1I a widespread lack of knowledge about the overall EKS system in 
niany coemiunities, even within subunits of the system itself, with only , 

> a few officials even recognizing this as a problan. In other words, 
although many of those who must plan or take part in EMS in diasters- are 
intimately experienced in some part. of fhe syst^, few have a sufficiently 
broad view to understand how the functioning of one part of the systen . 
relates to all the other parts. Thus it is difficult to arrive at a sound 
T)lan tor interaction of the whole systen when circumstances are extraordinary. 

4. Self-interested and at tin>es dysfunctional pofiticaT considerations enter 
into all aspects of 043 planning and response,. even in disas^:ers. 

5. In mass energencies, accurate on-site assessment of the need for D^S 
alnx)st never occurs. 

6. Meaningful, on=3H;te triage and initiation of treatment is seldoni attempted 
in disasters and mass casualty situations, resulting in several problems, 
particularly*for hkpitals. 

I 

7. Poor intra- and i/ter-organizational ccCTHunicatfons are cc^ron in disasters, 
but this is due less to lack of communication facilities pV se than to 
information overload, confused and distorted messages, and absence of 
trained cqrutunication personnel. 

8. , Extrication, transportation and distribution of victims of mass urgencies 

leaves much to be desired, sometimes with unfortunate consequences for 
the medical care, given victims. 

9. In some instances, although by no means in majority of ca^es^are given 
to regular hospital patients during the trans-disaster period falls below 
acceptable standards because so much attention is given to providing EMS 

to disaster victims.. 

10. During disasters there is inadequate attention paid to standardised record 
• keeping making post-disaster evaluation bf activities almost impossible. 

11. Centrally coordinated EMS responses are rare in mass emergencies', particularly 
in situations where there are large numbers of resources available. 

While the overall picture of EMS in disasters is not very good, instances 
of effective and efficient responses in certain disasters indicates that 
increased communication, interaction, planning and cooperation among EMS 
sector components can bring about desirable changes which can improve EMS 
care in actual ma^ emergencies. 
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DISSEHirjATIOH OF RESEARCH RESULTS : ^ ' 

The following list outlines current and projected publications of research fWd 
ings and involvements with EI^ organizations. 

L Papers and Presentations 

J. A. Golec and P. J. 6urney,\"The Problem of Needs Assessment in the 
Delivery ^of EMS,'' a paper presented at the Midwest Sociological Association, 
Minneapolis, Minnesota, AprtT<J977. 

V.'A' Taylor, and K. J. Tierney, "The Provision of Emergency Health Care at 
' Two Bicentennial-Celebrations." Forthconying 1977. 

J. Tierney and V. A. Taylor, "EMS Delivery \\\ Disasters; Preliminary 
Findings," a paper to be presented at the Annual Meeting 'of the APHA, 
Washington, D.C, October 30-November 3, 1977. 

M. F. Worth and J. L. S^roup, "Some Observations on the Effect of the 
EMS Law on Disaster Related Delivery. Systems," a paper presented at the 
Midwest Sociologic'al Association, Minneapolis, Minnesota, April 1977. 

J. L. ^Neff, "Bes^eflsibility for the Delivery of Emergency ftedical Services 
'in a Mass CasihUy Situation: The Problem of Overlapping Jurisdictions." \ 
Preliminary Paper #35, The Disaster Research Center, Columbus, Ohio. 

;J. E. Wright, "Interorganizational Systems and Networks in i^ass Casualty 
J Situations," a paper presented at the Annual Meeting of the APHA* 
October, 1976. 

\ J. E. Wright, "Coordinating Emergency Medical S^ervices in Mass Casualty 
Disaster: The Ideal Versus the Reality." Preliminary Paper #33, The 
Disaster Research Center, Columbus, Ohio. 

J. E. Wright, "laterorganizational Relations as Structure and as Action: 
The Case for Emergency Medical Services In Disaster." Preliminary Paper 
#37, The Disaster Research' Center , Colimibus, Ohio. 

S. Reynolds and J. E. Wright, "A Selective Literature Review of Disaster 
Medical Services." . « \ 

S. -Reynolds, "EMS Planning and Disaster Response." 'Forthcoming, 1977. 

K. J. Tierf>e^ and V. A. Taylor, "A Methodology for Evaluating Disaster- 
Related EMS." Forthcoming, 1977. ' - 

P. J. Gurney, "Factors Affecting Distribution of Victims In Mass Casualty 
Situation." Forthcoming, 1977. 
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V. A. Taylor and K. J. Tierney, "EHS Configurations and Their- Impact on 
Disaster Response." Forthcoming, 1977. 

V. A. Taylor and K. J. Tierney, The Delivery of Emergency Medical Services 
in Mass Casualty Situations (an edited book to be published sometime in 
the year fallowing the completion of the research). 

S..A. Blanshan, "A Timeilodel: Hospital Organizational Response to Disaster," 
Disastef* Theory Snd Research . Sage Publications, 1977.. 

R. R. Dynes, "Delivery of Emergency Medical Services in Disasters, "'a paper 
presented at the Second International Conference on Etoergency Medical 
Services, Baltimore, Maryland-, May 1976. '* < w • 

"K. J. Tierney, "Emergency Medical Systems Responding to Disasters; Part I," 
a presentation at the Mi crorCommuni cations Workshop^on EMS, Columbus, Ohio, 
June 1976. 

t 

V. A. Taylor, "_pnergency Medical Systems- Responding to Disasters: Part II," 
a presentation at the Micro-Communications Workshop on EMS, Columbus, Ohio, 
June 1976. 

S. A. Blanshan, "An Open-System Perspective on Organizational Change: 
, The Effect of Environmental Change on Organization Structure," a paper' 
presented at the North Central Sociological Association, May 6,* 1976. * 

II. A Theoreticail Statement' 

J. E: Wright, "Interorganizatlonal Systems and Networks In Mass Casualty . 
Situations." " : \ . , ■ • , 

III. Involvement with Local EMS Organizations ' ' 

DRC conducted field research in Washington, -D.C. and Philadelphia during 
the 1976 Bicentennial celebrations. -One of the objectives of th.is 
research was to determine whether prfbr EMS planning would reduce the" 
demand for non-emergency hospital care during a perfod of tiiass conver- 
gence andj5o-*<hat extent. A monograph will be written containing case 
studies ai5out aJS efforts In these two cities duringxhis period. 

A simllar^tujtjndre sys^tematic study was cohdu"ct5^ with the cooperation of * 
local JEMS personnel In New -Orleans during Mardi 6ras 1977. Data were 
gathered, on emergency department visits at ten New Orleans hospitals for' 
a five-day period.- The data are presently being coded and keypunched. 
.Results will be made atailable to the local EMS Steering Coimiittee. ' 
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Richard R. Lanese, Associate Pr.ofessor 
(Co-€nvesti gator and Project 

Direc tor --^Seral dine B. Keller) 
Department of Preventive Medicine 
The ^PMtr3 tate University ^ 
410 West Tenth Avenue 
Columbus, Ohio 43210 
(614) 422-8376 



FUNDING LEVEL : $16,242 FY 77 
\ $60,08? FY -76 



TOTAL PROJECT PERIOD : 8/01/76- 

11/30/77 



SIGNIFICANCE : 

There is growing emphasis on the development of cofnmunication systems to 
facilitate response to emergency medical calls for medical help. This 
trend i^s ^evidenced by increased allocation of funds for this purpose by 
gublic and voluntary agencies^ at national, state, and local levels. The 
investigators believe ^that it is particularly . important, at this time, .to 
focus on the rt)le of the recipient of the calls and/or the EMS dispatcher, 
who stands as the "gatekeeper" of th^ emergency medical services response 
system. For the most part, the focus of attention has been on hardware? 
such as the development of "911" call systens and the use of special 
receiving and dispatching equipment and telemetric devices. The training . 
of emergency dispatchers has been largely directed toward the machinery 
involved in tfieir work. Emphasis has been placed largely on how to answer* 
a call, how to locate the sqene of the emergency evfent, and how to dispatch 
aid. Guidelines for dealing with the public have been rudimentary.. Little- 
or no attention has been given to the interchange of Information batwsen 
the caller and the recxp'ient and to the development of programs for train- 
ing EMS communtwtions personnel to el icit» information regardir^g the nature 
of the emergency event, to offer ^appropriate advice, and to interact effec- 
tively with people in stressful conditions. The object of the present study 
is the development* of a guide for EMS communications training that will allow 
each community emergen'cy medical system to examine the calls entering that 
particular system and to develop training programs for their own personnel. 
This approach offers the advantages of relevance to th^e local situation, 
attention to the specific needs of each community, and the acquisition of 
experience in training at the local level. . - * 

' project DESCRIPTION : 

The Columbus, Ohi(^^ Division of Emergency Medical Services records all of the 
incoming calls for medical assistance"Dn master tapes. Arrangements were 
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made to record these calls on cassette tapes for the purpose^ of a study 
^recently completed on the content of emergency messages. T^ed transcriptions 
were made from each of the calls and Wie cases were followed to determine 
emergency transport and ftospital admission^ecisionsr 

Panels of emergency physicians, emerger^y roenn nurses, and emergency 
dispatchers were selected to listen to a sample of IQO calls representing 
a variety of emergency problems dealt with by the Columbus EMS system. 
These calls were chosen by the investigaTOrs as^cases, illustrative of 
problems encountered in- the aforementioned stud^of emergency messages. 

A typewritten transcript of each call was rev«^£l in order to identify the 
portion of the^.interchange between the caller "^d the recipient that would 
offer the panelists information to: ' * - 

• \ 

. * (1) RecQ?nmend the questtt^is- that should be asked of the caller to 
clarify the nature of the emergency event. 

(2) Indicate the advice that shoufd be given to the Caller regard- 
ing actions tha^t are to be taken while help is on the way. 

(3) Specify an appropriate dispatching decision for the given case. 

(4) Describe the probable nature of the emergency event and the 
circtmistances surrounding it, 

(5) indicate what actions the emergency fffeffical technicians may 
have had to take at the site of the emergency event. 

(6) Indicate the likelihood that the patient would require trans-, 
portation to a hospital emergency' department, 

(7) Indicate the likelihood that the patient would require admission 
to the hospital inpatient services. 

(8) Indicate probable admission diagnoses. 

The calls were edited in order to eliminate clues~t(i the*answers to the above 
questions without "distorting the meaning of the message. Responses are 
being collected from each -of the three groops of parielists in order to - 
determine the agreement. or diversity within groups -^nd between groups. 

Fet^ach of the cal^s th&t is presented, information is available regarding 
the actual findings of the responding enjergency squads, t^§ir decisions 
■regarding transport to"* hospital emergency rooms, the decision dT the ER 
personnel regarding admission to inpatient seryices, and the admission 
diagnoses. Using a modified Delphi method, th4 panelists reconsider their 
responses and are then presented with the actual follow-up information 
regarding each of the cases. The pane'ls are then convened in order to arrive 
at a consensus regarding th^ best set of responses in each case. Finally, 
these responses are used to develop a set of algorjihifts or guidelines .for 
training the emergency communications personnel. . • 
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The results of these efforts will be pres^nfted tb the emergency di^spatchers 
on duty in Columbus, and they will be asked to utilize the guidelines and ^ 
^to offer their critiques. The object is not only to present speci-fic 
algorithms for EMS cofflnuni cation personnel, but to. devise and. demonstrate 
t method that can be used economically and conveniently by all communities 
that wish to develop training progtajSS of their own. 

PROGRESS: ; ,.. . ^ * . . 

.A number of technical, prjK|^were encountered In the re-recording of the^ 
messages to present only tj^^Ppropri^te information^ to the panelists, 
without reveal in5 clues to the answers that are.requested of them. These 
problems have beeh solved and it is now felt* that. the method can be readily 
cxirriejJ out, in any community emergency communication sysjtem. Arrangements 
have/een made for recruitin p^a lM)ropr1ate panelists. This required a complex 
schMule of incJdvi^usrTj^^ and the guidelinss for such 

scheduling will ino^fflpm project report. Actually, it is apparent 
to the investigators thatnt^will ba^^possible in the future to carry out this 
.process with much less comp^ex^ty. than was involved in the initial /effort. 
A set of questionnaires and '^lfesponse fonns for the panelists are bfeing^ developed 
and pref^lred for field testing. \- ' / 



DISSEMINATION OF RESULTS : 

= <5 
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As the study data are acquired, reports will be prepared of the study hethods 
and the range of responses , obtained from panelists with regard to ilTu^l^tive 
cases. Prior to' the preparation of the final report, a number of smaller" 
reports and publications will be submitted on different*aspects of the results. 
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TITLE: Effectiveness of Advanced EMTs GRANT NUMBER ; 1 ROT HS 02536 

, Versus Basic EMTs 

"i — ' 

GRANTEE rNSTITUT^ON : Trustees of Boston University ' ' \ ^ 

S PRINCIPAL INVESTIGATOR: ^ ' • FUNDING LEVEL : $91,990 FY 77 

Michael W. ^ozen, M.D., Sc. D. , ' - 

"Division of Cardiology and Health Service^ 

Sears 1 . _ ' ^ 

BostoivXity Hospital , - • TOTOL PROJECT >ErToD : 7/01/77- 

818 Harrison Avenue = fiAn/sn 

-,Bostoi>> Massachusetts 02118 o/^u/ou 

":{617) 424-4465 . ' 

SIGNIFICANCE : ' ' " ' • 

Nearly one million persons per year have ffiyDcardiarinfarctions in the 
United -States and of these three hundred seventy-five thousand patients 
die, yielding a 282 case fatal ity '.rate for. myocardial infarct;ion. Threfe 
basic reasons are cited to account for "these figures: 

1) Two-thirds of patients with rnyocardial infarction never reach 
medical assistance. 

. 2) Patients delay in calling for help due to denial of presenting 
symptoms and/or ignorance. 
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^) Seven percent (7%) of patients cannot be resuscitated by ' ^ 
* ambulance trews at. the ir~y rival on the scene. ■■ ' 

Jterlr are further data which suggest that a high proportion of 
"OTd^len deaths" from myocardial infarction die not froft) irreversibfe 
cardiogenic shock, but rather from treatable, post-myocardial-infarction 
arrhythmias. Patients who reach coronary care facilities ha^e an Improved 
chance for sj^ivaT. . • _ 

The principal objective of the proposed research then, is to evaluate the 
effect that advanced training of EMTs (Emergency Medical Technicians) has 
upon the quality ot prehospital patient care. The quality of prehospital 
patient care deliv^ed by advanced EMTs wijl be compared to. the quality of 
prehospital patient care delivered by basic EMTs. in a discrete, semi-rural 
area— Cape Cod, Massachjisetts. The advanced EMTs have Been traine'd in a - 
3Q0-hour community coHege^coiirse. ^aslc EMTs are those who have been 
trained tn an 81 -hour natibnally-sQpnsored EMT course.^ 
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This project will evaluate the impact .of Advanced Emergency Medical 
Techiiicians on the treatment of victims of Myocardial Infarction (His). 
Since the Country .is apparently going to make a substantial investment in 
th,is area, definitive information on the utility of EHTs will be of 
coi;jsiderable value. 

Advanced EMTs are thought to be better equipped in terms of their diagnostic 
skills, their clinical judgment and their range of therapeutic modalities. 
It «is further assumed that the appropriate use Of these advanced skills 
will result in improved patient care, manifested principally as reduction in 
condition-specific case-fatality rates. This research^ vnll examine these 
. tWQ' assumptions. 

PROJECT DESCRIPTION : V 

The basic aim of this study is to evaluate the effects on pa^tient outcomes 
of the performance of additionally-trained EHTs as compared to a similar 
group of patients cared for by basic E|1Ts. On Cape Cod, there are 20 fire 
department ambulance and rescue services. These services are staffed by 
239 EHTs {122 full-time) who have completed the natipnal 81-hour course 
and have passed theUStional registry exam. There are an additional 
108, basic .EHTs on Cape Cod who serve 4n a limited, voluntary capacity 
with various rescue squads. Twenty of the^e 239 basic EHTs have completed 
a 3Q0-hour advanced EMT course at Cape Cod Community College. Their 
. practical training was at the Cape Cod Hosp^tah The training covered' the 
gamut of advanced life support methods irta critical case situations, 
though the emphasis of, the training was on* tr^tmeftt of patients With 
acute His. ^' 

Eighty percent of the advanced training offered has been in advanced cardiac 
care,. including electrocardiogram (tCGj TOnitoHng and telemetry, defibrilla- 
tion, intravenous antiarrythmic therapy and adninisfration of cardiotonic 
drugs. Since'the emphasis ha? been on advanced cardiac traping,, the 
greater portion of this research is focused on cardiac emergencies. The 
existence already on Cape Cod of two groups- of EHTs, advanced and basic, 
.pfrovides the basis for a controlled trial- between two populations which can 
be retrospectively matched. ( ' - 

A comparativa experiirental design will be employed. Fundarontally, the 
process and outcomes of t^^kjj^x the group of patients treated by the 
advanced EHTs versus the basic Bl^hour EHTs will be assessed. The process, 
parameters are symptom recognition and appropriateness of treatment; the 
outcome parameters are proximal survivorship, long term survivorship, and 
•res^ldual .disability. The two groups of patients for each comparison will be 
retrospectively matched for diagnostic category and stratification variables. 
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There are four secondary aims to this study: 

w '.• ■ ■ J , 

1, The effect of a series of stratificatioji variables will be 
retrospectively examined to determine their effect on the 

• outcomes achieved by advanced versus basic EMTs. Mn particular, 
vaHables such a'S age, length of delay, past history and severity 
which can be reasonably and easfly assessed by EHT dispatchers 

^ on the phone will be examined.. 

2. A thre|hold scoring system of these stratification variables for 
.uSe by ambulance dispatchers will be -developed. EssentialTy, 
the ratio of computed -probabilities for sur\Mvorship between a 
logistic regression* functimi of these stratification variables 
for the population cared fo^sby advanced EHTs and a logistic 
regression function of the vaHables for the fi^ulation cared 

^or by basic EMTs will be used. 

3. Availability of a second" group of advanced EHTs in year two of 
the study will permit evaluation of the effect of experience 
superimposed on advanced training in terms of patient outcomes. 

4, The "effects of the influx of a large population (due to summer 
visitors)-, on EMT performance and subsequent outcomes will be 
examined. From June 1^ to Septatiber 10, the population of 
Cape Cod increases by a factor of '3. 5 (141,559 to 475,000).- 
One can hypothesize from the fact that the population of Cape 
Cod triples during the suiimer that the EMTs' skills would either- 

• improve due to the increased experience or worsen due to fatigue 
brought on by the increased work load. The effect*of such an 
influx of people on the performance of EHTs will be analyzed. • 
In particular, ching.e of response time, change»in proportion of 

^ correct diagnoses and changes^ in case fatality rate for myocardial 
" infarction wi'll be' examined.'.' Congressional testimony concerning 

the EMS bill has specifically cited the need for an examination 

of this problem. 

PROGRESS : ' ' ' 

A Technical Advisory Group' has been assembled and collaborative arrangements 
established with the training college, the 3 hospitals serving Cape Cod, the 
region XII Comprehensive Health Planning Agency, as well as the ambulance 
services .for. the area. . 

DISSEHINATIOH OF RESEARCH RESULTS : ' . ' , ' 

Results of a pilot project conSlrned vi4h the feasibility of conducting an 
, evaluation in this setting were reported to the Injury Control and Emergencgt 
Medical Services Section of the Annual Heeting of the American Public fiealtft 
Association' in November 1976. • > 
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TITLE ; -Effect of^urntducatlon on GRANT NUHBEB :. 5 R18 HS 01801 

.Quality of Emergency Care 

■ 

GRANTEE INSTITUTION : University of Miami School of Medicine 
* • . 

PRINCIPAL INVESTIGATOk :* FUNDING LEVEL :' $118,211 FY 77 - 

\ . $132,045 FY 7^ 

Bernair^ S. Linn, H.D. $123,620 FY 75 
Assistant Professor of Surgery 
Veterans Administration Hospital* 

1201 N.H, 16th Street , » TOTAL PROJECT PERIOD : 6/30/75- 
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(305) 324-4455 , • ' ^ 

SIGNIFICANCE : . ' * 

This project is designed to determine the extent to which an innovative 
program of continuing education can improve the quality-of care- del ivered 
to* burn patients seen in emergency rooms at community hospitals In the Miami 
area. The- feducational program is directed towards all^^i^rgency room personnel, 
ijicluding physicians, nurses, and occupational and physical therapists* ^ The. 
project design pennits testing whether, and to what extent, education will 
increase the quality of care delivered t;o these patients. If reinforcing / 
- conmunity hospitals with continuing medical education does significantly enhanre 
their capability to .provide aeceptable care to burp^ VTctTTss , an enormous amounjt 
of time, dollars, and lives can be' saved. Arming^communityi hospitals with the 
skills to care for some burn patierits as well as'^ey are tjheated in teaching 
institutions could become an c^cceptable strategy t^i^utupe resource allocations 
and may be preferable to the development of additionaT^^pecialized burn units 
if benefits are equivalent and costs are less. 

'PROJECT DESCRIPTION : 

The experiment's dasigiT^ such that, there will be 20 community hospitals 
involved in the project at the end of the second experimental year. The 
"hospitals were randomly assigned to one of two groups: experimental or control. 
The experimental hospitals receive an educational package whereas the control 
group does not. The educational intervention consists of •four components: 
seminar, manual , .hotline, and feedback to* physicians. 

A) SEMINAR: These are th^^-hour sessions in which curVent burri treat- 
ment information is prSfnted to each experimental hospital. The 
seminars have been, approved for contimjing education credit by the 
American Medical Associati-(yi as well as the Florida Nursing Associa- 
tion. ky\ emergency room* personnel are' req^jted to attend as are 
any other Interested hospital staff. 
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B) MAfJUAL: Emergency Room Burn Care is a manual that was specifically 
developed for this project. The manual provides a format for the 
seminar ami is designed to be ^asy to understand and to use. Jhe 
manual includes five algorithml'or flow charts tha^specify proper 
procedures for treatment of burn patients who arfive at emergency 
rooms under different conditions. Eaeiu^flDri tbm is followed by a 
Notes Section that describes in detail the clinkgi^atfonale for 
the treatment steps recommended. 'During the seminar it is emphasized 
tjiat the manual does not represent the only way to manage a burn 
vrtttm, but rather a tried, accepted and proven way that does y/ork. 

• 

C> HOTLINE: A hotline telephone service to the Burn Unit at Jackson 
Memorial Hospital is available to these conmunity hospitals on. a 
24-hour-a-day,' every day basis for answers to any questions, large 
or small, thaf they, have concerning the care of burn victims. 

D) FEEDBACK TO PHYSICIAfiS: This component serves a dual purpose: 1) it 
is part of the education process in that it continually reinforces 
the physicians in tl^eir clinical behavior and 2) it enables the 
investigators to analyze the educational impact. In each of the 
^ ^ experimental hospi,^>s, every physician vmo treats a burn patient 
receives feedback. Feedback,.consists of a coded checklist that 
describes compliance or. disagreanent with the treatment regimen 
presented at the seminar arid in the manual. A request is made that 
the physicians respond to 'the feedback by "feeding back on the feed- 
back." This is easily accomplished by returning a self-addressed 
stamped postcard to the Investigators with any feactions the physician 
might have to the .feedback. 

Data coll ecti Off begins immediately after a's^inar has been conducted at a given 
hospital^. ' Two types of data are being collected:" process and outcome. The 
process data is collected by a trained nurse clinician who examines the patient's 
chart in gVeat detail. Outcome variables are collected by the research social 
workers who visit the patients approximately two weeks after they have been 
treated in the emergency room. Patient satisfaction and cc^pl lance with any 
home care advice are some of the types of information collected from patients. 
Patients who have been admitted to any of the. hospitals are visited not only a^ 
two weeks but also at three months, to <^teniiine their satisfaction with jthe 
hospital care-and tojJetermlne their long-term status. 

PROGRESS ; 

The first data collection year ended In >larch 1977, and as of February, data 
on «yer 2000 patients have been collected, 123" of whom had been admitted to the 
"hospitals. The niBrf>ers of patients seen at q^perimental versus control hospitals 
were very s.imilar: 



EXPERIME^rrAL 

CONTROL 

TOTALS 
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TREATED & RELEASED 


ADKIHED 


TOTALS 


984 


'73 . 


1057 




50 • 


1001 


• 

1935 


123 


2058 



GO 



'Bernard S. Linn, M.O. 



The project will continue through two study years, and it is too early as yet 
to make comparisons between experimental and control groups. Interrater . 
reliability tests to date between two social workers and also between nurse 
clinicians show good correlations. 

DISSEMINATION OF RESEARCH RESULTS ; 

Although no publications have yet resulted from this project, it is prtJducing 
a tremfendously valuable source of data about burn victims, resulting a 
number of presentations concerning burn prevention, cocipliance with treatment 
and patient. satisfaction. Abstracts have been submitted for possible 
presentations at national meetings. Presentations were made at meetings of 
the American Burn Association in 1976 and 1977 which discussed the design 4)f 
the. project, the educational package and the pitfalls' in collecting data about 
burn victims. 

Accepted for presentation at the American Public Health Association Annual 
'* Meeting in October/November 1977: 

J. Wetter, R. Pollack, and B.S. Linn, Problems in Providing Effective 
ContlTiuing £djication In. the Einergency Departments . . 
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EvaTuatiob of er^rgency radical care is limited by the fairly cudimentary 
methods of Nsedjkal care evaluation in general. Emergency medical care 
evaluation can be considered in terms of structure, process, and outcane 
measures. Outcome measures of medical care include patient mortality and 
morbidity. The extent to which mortality and morbidity rates can be 
affected byTHS-^ysten per'formance is difficult to determine, as demonstrated 
by the confusion concerning the relative importance of lowered speed limits 
versus improved emergency care in reducing highway accident death rates. 
The effective measur^nent of eniergency medical' care outcomes requires a way 
to compare the results of treatment for patients whose risks of death and 
disability are similar, and therefore requires Ihe development ©f reliable 
and valid indices of the severity of injury and^llness. 

Jhis res^ch project focuses on the development and validation of such an 
index of-injury/iVlness severity. A .good index would be canputed for each 
emergent and urgent patient using weighted combinations of available informa- 
tion about vital signs and symptoms, and would describe patient status at a- 
single po'int in time. However, a patient's status as measured by the index 
could also be assessed at several points in time, and thus the index could 
-also serve' as a surrogate outcome measure for the pre-hospital and Bnergency 
Department care phases. An,.index of illness or injury severity should make it 
possib>e to compare the results of care provided by different rescue units or 
'different hospital er«rgency departments over a broad group of patients. 

Severity indices can be used to triage patients to the appropriate facility 
■ and to alert emergency department staffs to the urgency of care needed; to 
standardize cohorts of patients for epidemiological and clinical studies; to . 
compare-the quality of care rendered by ambulance services and Emergency 
Departments, with one another; and to predict health outcomes of patients. 
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PROJECT DESCRIPTION; 

/The goal of this research project is to develop ao index frcxn readily-available 
/ data which is predictive ot^patient outcome. The <^entral asspomptions under- 
lying the construction of siich an index are: the e?^stence of some measure 
of the severity^ the paTrent's condition; the deveTD]^nt of a scale which 
will measure this^everity reliably; the existence of a relationshTp ^ 
between measurements of the patient's current status ^nd predisposing ^ 
factors to the eventual outcome. 

A rigorous systematic approach is aow beinj^ taken towards the develofKnent 
of an index that progresses thr(iy^ six general phases of work. They are 
as follows: ' , ^ 

(1) . Determination o^ which data elements are essential to collect; 

the establishment of precise definitions for those data elements 
as well as tiniform procedures for their measurement; and testing 
of the reliability and validity with which the data el^^ents can 
be assessed. ^ 

(2) Testing the availability of the data elenents using t^e proposed 
methods of collection; 

(3) "Testing the reliabitity and validity with v^rtth the data ele^nentS 

can be abstracted. 

(4) Development .and reliability and. validity testing of an outcorr^ 
measure more sensitive to variations in patient severity than 
the binary live-cfie measure. 



(5) .Analysis of the collected data to Tead to the developx^ent of an 
* index or indices with certain desirable properties (e.g. ease o 

computation, medical plausibility, accurate prediction;. 

(6) .Validity testing of the index use and comparison with other 

outcome measures. • , 

The first four phases of work outlined above have been completed. The 
determination of the data elenents was based on the development of scenarios 
that were reviewed by a panel of physicians;, they were asked to list any 
data element they felt was necessary to predict patient outecxr^.^ In addition, 
four physicians coa^pleted literature reviews in the general %reas foi: which, 
indices will be developed; cardiac, trauma, respiratory, unconsciousness. 
Since these four areis make up 50? of emergency patients, enough data could 
be collected to develop the indices. The purpose of these revievrs was to 
delineate risk factors in each of these cHiiical areas and to indicate 
additional data elements that could be collected by EKT's'^or in the Emergency 
Department during the first 30f minutes. ' At the completion of the panel review 
and^>j^views of the *1 iterature on cardiac, respiratory, unconsciousness, and 
tfaumi risk factors, an initial list of data elements was selected.^The 
e;eis^iC9 fire rescue fopm and hospital Emergency Department records were 
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reviewed to. determine which of the elements were aviillble. The resu>feSH3rf 
this review indicate that the forms requested most of the data elefRehts of 
interest. This list of data elements will continue to be revised' in light 
of further informat^ion, 

Follov(ing the selection of ten qualitative and quantita^tive data elements, 
fire res.cue personnel were trained and tested with an RK serving as a 
standard. Their training continued until they reached a level of competence 
necessary to insure reliable data. Within the Emergency Department, tests 
were undertaken to insure that the, values obtained^were within tolerance 
ranges. Correlations were then -obtained between research assistants in the 
use. of an outcosve scale, the results of which suggest the data can be obtained 
in a reliable and-v'alid manner. The procedures used in the development of 
' the scale were to: 

(1) create a scale with a particular set of definltioos; 

(2) test that scale on a nunber of patient records; 

(3) compare the scores 'obtained byeach research assistant; ' 

{^) discuss with the research assisrtants the causes for the 
discrepancies; ^ 

' {5} revise the "definitions to eliminate the discref>dx)dies and; 

■ "\ 

'(6) begin the procedure again with a new group of patient record/ 

This scale is designed to be used by reseanch assistants with clinical nursing 
jjackgrounds yiho assess each patient in six body functions at several points 
in time using information available in the hospital records. 

DISSEMIUATION OF RESEARCH RESULTS : 

, Publications and Papers ^ 

1. L. Cole, If.A.» C. G. Cayten, M.D., M.P.H., N. Hermann, Ph.D., S. Walsh, R.N. 
."Improving the Accuracy of EMS Clinical Data" AP4iA Coovention, Miami, 
October 19, 1976*. ' . ^ 

2. C. 6. Cayten, H.D., M.P.H. "Severity Indices and Their Implications for EMS." 
DHEH Symposium EMS Evaluation, New Orleans, January, 1977. 

3. H. Won,. M.S., S. Walsh, R.N., N. Herrmann, Ph.D., L. Cole, M.A.,^ 

■ C. G. Cayten, M.D., M.P,H. "Assessing the Validity of EMS Data." » To be 
presented at University Association for EMS! " 

4.. N. Herrmann, Ph.D., C. G. Cayten, M.D., M.P.H. , J. SeniorTM.D., * 
.R. Staroscik, M.D., S. Walsh, R.N., H. Woll,,M.S. "'intlr-observer and 
Intra-observer Reliability in the Collection of EMS Datk" To be ' \ 
presented at APHA Convention. 
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SIGNIFICANCE : . ^ ' 

The overall objectives x)f this EMS Research Program are to develop'^and apply . 
methodologies to describe current modalities of emergency medical care and 
to assess the impact of interventions aimed at improvement. Pro^j^t I 
deals with system-wide interventions (such as jp^ionaliza^on, communications, 
EHT training, etc.) and is being conducted in the five-coffey Baltimore 
region. Project II focuses on health education and other service interven- 
tions introduced at the inxlividual emergency-room level and is based in the 
OTergency departments of The Johns Hopkins Hospital and Baltimore City 
Hospitals", as is4>roject III, the focus of which is clinical interventions. 

At present $185 million have been awarded under the Emergency Medica] Services 
Systems Act of 1973»and 1976 and $25/nillion by the Robert Hood Johnson 
Foundation to enable communities to plan and operate EMS systems. A major 
requirement is. that systems categorize their hospital facilities and thereto 
reduce inappropriate utilization (both under-use and over-use). In addition, 
the new Health. planning legislation requires Health Systems Agencies to be 
concerned witfa the appropriate coordination of regional an3 specialized 
health. services, including emergency medical care. Nevertheless, there Is 
not presently available a methfedology to assess current emergency department 
utilizatioq; nor one to assess the effectiveness of categorization iri^ v 
modifying itilization. . Further, there is insufficient evidence currently ^ * 
that. the suggested system-wide interventions change utilization or that sucti 
changes are associated with improvements in processes and outcomes of emergency 
care. Project I is developing and applying such a methodology, to facilitate 
an assessment of the effectiveness of regional interventions and an evaluation, 
by process and outcome measures, of the return on the considerable public 
investment to date. ' . ^ ^ 

With regard to Project II, it is clear that emergency room utilization is at a 
high level nationally and increasing rapidly. As the trend of the past two 
decades continues, increased ER usage cannot be attributed to concomitant 
increase in the incideijce of cUnical emergencies, but rather results from the 
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emergency department's assuming a primary health care function for -patients 
unwilling or unable to secure health care from alternative ambulatory care 
sites. Consequently, it is important to attempt to determine what inter- 
ventions can be introduced in th& services provided by Emergency Departments 
to improve the qual-ity of care the. face of this increase, and to examine 
ways whereby non-urgent £R usage can be diverted to alternative health care 

^delivery sites. Project II is mounting and evaluating service interventions 
aimed at these issues. The significance of Prdject III stems from the fact • 
that despite the resources involved in hospital-based emergency care and- the 
crucial significance of the quality of care provided-, very little'is actually 
known about the quality . and outcomes of anergency^ department care. From thS 
perspectives of training and of evaluation, an emergency department is one of 
the few settings of health care delivery where providers do not routinely see 
the consequences of their clinical mana'gement. Patients appear, are treated, 
and are discharged with little likelihood that^the initial provider will see the 
patient on follow-up. As a result* one of thlmost important learning mechanisms 
IS denied the Emergency Department physician aVid nurse. This has served as a 
powerful deterrant to developing knowle^dge systematically concerning jihe 

.effectiveness of clinical interventions in the emergency department. Project 
III is specifically addressed at resolving these deficiencies. 

PROJECT DESCRIPTION : 

Project I isdeveloping, and applying in the Baltimore prea, methods to 
describe the present level of patient utilization of- local hospital and 
ambulance emergency facilities, and is assessing the impact ofrcategorization 
efforts on these patterns of system wicfe interventions. A set of resource 
standards has been developed which specifies the hospital resources needed 
for the treatment of the emergency conditions listed in the Emergency Medical 
Services Systems Acts of 1973 and 1976: trauma, acute cardiac, burns, high 
risk infants^ poisonings and behavioral emergencies. These resource standards, 
as validated by nationwide; samples of expert clinicians, are be^ng applied to 
data describing resources at hospitals treating patients with these conditions, 
so that each hospital can be categorized on a condition-specific basis as to 
its resource level and therefore its appropriateness for treating each condi- 
tion. A categori2ation model-, including the prevalence of each condition and 
the prebability that patients with these conditions will need each resource, 
has been developed. " It is being used to generate various regional configura- 
rFon§__Qf hospital emergency resources in order ^o assess which categorization 
scheme best maximizes tlie resource combinationrfor each clinical condition. 
After eaph hospital has been categorized to /allow normative statements as to ^ 
wheVfi_^rgency patients should be treate^Mutiliz'ation data will then be ^ 
secured for each diagnostic group from each l^spital , identifying where 
emergency patients ^are being treated at present. The survey is being repeatecl 
at subsequent time periods to evaluate the. degree and quality of changes in 
utilizatibn patterns resulting from regionalizing the resources. Information 
is also being secured on the use of clinical resources specified as necessary 
within each hospital, by diagnostic group and the. outcomes of selected emergency 
conditions. A secondary tasf is to assess the appropriateness 'of emergency 
ambulance utilization by measuring unmet ambulance need and inappropriate 
ambulance use. This is being approachrd. by the development of ambulance 
standards for each of the diagnostic conditions, specifying whether or not 
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patients with a given condition should receive ambulance care and what 
resources should be- available on the ambiLjance transporting them. These 
standards will then be applied to abtuSl'ambulance utilization data to 
'describe the .level of appropriateness. In addition, ambulance utilization 
data and reporting systems are being examined to determine feasible, economic 
and managerial ly-useful ways of describing and evaluating the nature and 
quality of ambulance care. 

Project II is evaluating the efficacy- and effectiveness of service interven- 
tions designed Xo improve patient c&re in the hospital emergency department 
and to enable emergency departments to respond more- effectively to increased 
patient demand for nonurgent services. Patient advocacy, health education 
interventions aimed at reducing household hazards and pediatric injuries, 
emergency room use by asthmatics, triage by nurses, etc., are all being 
Systematically evaluated. More particularly, there are two major foci-: sub- 
stantive and methodolo^ic. First, the intent is to evaluate the usefulness of 
service interventions directed at. improving the care needed by chronic and 
nonurgent patients, and to design and cond'uct a series of prospective field 
experiments (with random assignment to intervention-groups) to assess the 
effectiveness of health education strategies in reducing nonurgent use of 
emergency departxnent and of non-physician manpower in. improving care. The 
second aim is to develop, apply and assess methods by which enjergency depart- 
ments may monitor the quality of care given. 

Project III is describing and ^v^uati'ng quantitative measures of^ system 
^performance, developing outcome-^^v^^idated standards for treatiftent? of emergency 
*mfedical conditions, and assessing the ijnp^act of clinical interventions 
introduced under controlled conditions at the energency departments of The 
Johns Hopkins Hospital and Baltimore Ci^y Hospitals. For a range of diagnpstic 
conditions whiqh include hypertension, minor lacerations, chest pain, asthma, 
pn^imiQnia, and trauma, the fallowing, steps will be undertaken: describe and 
evaluate^jthe diagnostic iSb therapeutic procedures currently emfxloyed in the 
merg^y departments, identify or develop clinical interventions thought to 
improve patient outcomes, implement these clinical interventions and test 
their efficacy by random assignment of patients to experimental and control 
groups, and evaluate the success of the proposed interventions in improving 
diagnostic and therapeutic procedures and outcomes of emergency department, 
care, 

PROGRESS : 

The products of Project I in the first two years of ^ the research program have 
included: 

(?) The development of hospital and ambulance resource standards 
for each of the six high-risk conditions mentioned in the EKSS 
7\ct; 

^ (2) The face validation of the resource standards by nationwide samples 
of clinical experts; - 
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(3) .The development of a Categorization mod61 as a tool to assess 

the trade-offs resulting from alternative regionalizing schemes;-* 

(4) An assessment of the emergency patient information systenvs within 
the 23 hospitals of the Baltimore regional EMS system;* 

(5) The collection^of time series mortality rates for^gach of the six 
r,emergency conditions for each of the five jurisdictions within . 

the Baltimore region each year from 1968 to present; 

(6) The methodologic assessment of 3 7 frequently used tndices of 
severity; 

(7) The development of a sampling scheme for Emergency Department 
. utilization; 

(8) The analysis of 50,000 ambulance run sheets within the Baltimore 
region to develop quality assessment and monitoring methodologies; 
and 

(9) The developpjent and application of methods to assess the capacity 
of physicians, nurses and EMTs to correctly identify ten frequent 
cardiac arrhythmias. ^ ^ 

The products of Project II have been:' 

(1) A study which* indicated a high degree of concordance between provider 
and patient perceptions of appropriate clinical responses and sources 
of care for hypothetical emergency symptoms; ' • 

(2) A study of patients who walk^out of Emergency Departments Vef ore / 
receiving treatment and -the reasons for walking out; \ 

(3) A prospective study which assessed the impact of health education 
interventions (folTow-up by an asthmatic nurse, and' patient group 
discussions) upon compTiance behavior by asthmatic patients aad on 
return visits to the Emergency Department; 

(4) A study which found that nursing audit had a marked and beneficial 
impact on the quality of nursing care charted in the Johns Hopkins 

'Emergency Department; /^ 

(5) A study showing negligible impact by patient advocates employed in r> 
dn Emergency Pepartment upon the satisfaction, knowledge and compliance 
of Emergency Department patients; ^ 

(6) An evaluation which failed to demonstrate any impact by a health^^ 
education. Ttra.tegy upon mothers* knowledge and practice of home safety 
measures^ aimed at reducing pediatric household injuries; 

' 6S ' ' 
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(7) A stu(iy documenting a substantial Impact of a newly opened 24-hour 
urgent care^clindc In reducing inappropriate hospital Emergency 
Oepartment usag^ 

The prodQcts of Project III have been: ' 



(1) 



- {2) 



(3) 



/V series of descriptive studtSs documenting the use of antibiatlcs,. 
irrigation anlt suture materials used in the treatment of patients 
with uncomplicated minoi" wounds, which indicated an exc^tfogally 
low rate (1 percent^ of infection but found that only half of 'the 
patients tojd to return for suture remofal .actuaVly did so; ■ , 

A quality assesjsitent study which -developed and, atfjLlied criteria on 
^theaquality of care recei^ied by asthma patients , indicated accept- 
able care; , ' 

A 

A double-blind evaluation of two treatm^t protocols for the emergency 
management of asthma to determine whether a combination of subcutaneous 
epinephrine apd intravenous amiTiophylin (as opposed' to subcutaneous ^ 
epineplirine alone) would result in a more rap-id improvement of acute 
asthmatic episodes- and a. reduction ih the wa-lting \vA treatment time 6f, 
the asthmatic patient ^(it did not); . * ' . 



4) 



A descriptive study of patients presenting with che^ pain to asses 
the relative effectiveness of diagnostic and thera|ieutic procedures 
used and associated outcomes;. 



(5), A retrospective sti0' of 'patient screening for hypertension on pre- 
sentation at'thei Emergency Department, which described a high.propor- 
^ tion of patients wi±h hypertension* but a low proportion of ftatients 

recognized by providers as such; 

■* . . • . 

(5) A stydy which indicated that alcoholics presenting at, The Johns 

Hopkins Hospttal Emergency Department are likely to receive qualita- 
\ tively and quantitatively, better, care than that given to non 

. -" alcoholics; and c • 
' \ "V 
■ . .*' (7) the design and implementation of a surveillance systaj to monitor 
X Emergency Department utilization and 'to assess outcome of care 

' ^ re;ceived. . . 
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DISSEHIHATIOH OF RESLWCH RESULTS ; ' . ^ _ 

Pubflcartlons And Presentations i)ur1ng First Two Years Of 
Grant Per1od»(July 1975 *- June 1977^ 

1.* 6. Gibson and D. S. 6ann, Health Services Research 4S an*E£aergency Depart- 
ment Mdnage»^nt Tool, Paper presented at annual reetlng of the University 
Association for Emergency Medical Services, Vancouver, Canada, Hay 1975 
Published under same title; Journal of Ag»r1 can Colieqe of Epfergency 
' Physicians ; 5;1 (January, 1976), pp 49-52.* ~ 



4; 



^ 6. 



8. 



9. 



* I 

6. Gibson, Emergency Medical Services and Pre-paid Group Practice; Chal- 

•lenge or Money Loser?, Proceedings of 25th Group Health Institute, Chicago, 

June, 1975, 123-139, Group Health Association of /linerlca. . • • 

G. Gibson, Predicting the Unpredictable; Methodologies for Assessing 
^Oeoand for Emergency Medical Services, Chapter In Monograph; Methocjs for 
' Oeterm1n1r\g and Projecting Areawlde OesrAnd f6r Health Services, Bureau of 
H^lth P.lanning and Resource Oevelopeent, Health Resources Adralnlstrailon, 
OHEW, June 1975. . , • , 



G. Gibson, Needs^sessment and Prograa^Evaluatlon of Emergency Medl 
Services, Presenratlon at National Training Course for EMS A<te1njstra^ 
Center for the Study of Eiaergency Health Senrices, University of Penn 
August, 1975. ^ ^ . 



ns^^nla, 



.G. Gibson, Reglonallzajlon of Hospital Eser^ency. Services:* Natlonal Pro- 
gress and Research Studies, Presentation to uHEW (^ference on Hospital 
Categorization of EMS, Chicago, September, 1975. 

G. Gibson, ResourtJfc Inventories and Perfomance Standards 4br EKS Systeas, 
Presentation at National Tr^1n1ng Course for EHS Evaluators, Center fo^ the 
Study of Emergency Heal-th Services, University of Penr\sylvan1a, September,* 
1975. 

Y. Stafford and G. Glb^op. Kurslng Care.of tht Asthaatlc Patient In the 
Emergency Departsient: The I^ct of a ffu'rsing Audit, Paper presented at 
annual ©eetlng^ of American College. Of Emergency Physicians, Las Vegas, 
Nevada, Octoi^er, 1975, JQuynal of Eaerqency Nursing, July/August, 1976, 
pp. ?2-28. 

V. SUfford, Nursing Audit »1fj Thfe Johns Hopklrts Hospital Emergency depart- 
ment. Paper presented at annual meetings of the American PijfrMt^ealth 
As^latlon, Chicago, Noveaber', 1975. 

G. Gibson. E)<S Evaluation; Criteria for Standards and Resc*rch Dyj^s^lgn, 
Keynote AdSress, Section on Evaluation, First lntema,t5onaLCoafe'rence 
on Trauwtology, Baltimore, Maryland, May, 1976, and Heal tfiservtces 
Research. tSunsaer 1976)>H05-in. ~ ^ ^ 
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10. 6. Gibson^ EKS Research: Kethod61ogy Oevelofxaent or Substantive Applica- 
tions, Health Services Research. Winter, 1977, In press. 

11. G. Gibson, Regional Izatlon and Ecierqency Kedlcal Services, Chapter, In 
Monograph: Reqionallzatlon and Health Care^ Editor tH Ginzburg, U.S. 
Departfe«nt of Health, Education and Welfare, 1977, In press. , 

32. M.O. FottSer, G. Gibson and 0. Pinchoff, Physician Accc^iiS!^ of the Nurse 
^Practitioner Innovation, Working Papers Serly. Ko. 76j^ College of^sln^ss 
A<te1n1strat1on, University of iowa, ,Kay, 1975. 

13, G. Gibson, Inergency KedlcaJ Services and Manpower Training Requlren^nts: 
^ The Role of Schools of Nursing, ^d1 cine and Allied Health, In Proceedings; 
Selected Papers froc Health Manpower Education Conference 1974-1976j ^ 
pp. 186-192, ADerlcan Association of State Colleges and Universities, 1976. 

^4. G. Gibson, Measures*of Energency'tebulance Effectiveness; Uno^t A^^ulance 
Heed and inappropriate Alliance Use, Journal of Aoerlcan College of , 
Emergency Physicians, In press. 

15. G. Gibson, Categorization. and Reglonallzatlon of Hospital £r«rgency ' ^ 
Facilities, Hospmis ; Journal of Aaerlcan Hospital Association, In press., . 

*s . 

16. G. Gibson, Emergency Medical' Services: Federal Programing or Local Initia- 
tives in The Role of Local Govemaerfts in Providing Health Services, Acadessy 
of Political Silence, 1977 in press. ^ 

17. ' G. Gibson, Evaluative Measures and Data Collecxiop Methodologies for EMS 

Syste^;t$, Presented >t OHEW Los Angeles Confecence on Evaluation, April 1976, 
and Public Health Reports, in press. ^ 

18. k. G. JarDon and C.E. Yesalis, III, Provider Perforrsance in the Recognition 
and Treatnent of Teleoeter^ Electrocardiogram Patterns, Journal of Anerican 

. College of Eoergency Physicians, December 1976, 971-974. 

"19. C.E. Yesalis, III, H. Kuehn and G. Gibson, A Survey of Hospital EDergency 

Medical Infomation Systeos- and the le^licatJons for EKS gesearch and Planning 
paper presented at the 1?76 meetings of the University Association of 
EDergency Medical Services, Philadelphia, Pa., May 1976. 

*'20. A.L. Kaszuba, E. ♦^acKenzic'G. Gibson, tsergency De^rtsent Surveillwce: A 
Data 8a^je for^Patient Care Manage?>ent Research and Teaching, paper presented 
at the annual neetings of the African Collie of Eaergenc^ Physician^ 
New Orleans, La., October, 1976, Journal of AperUan Colle<?e of Energency 
Physicians ( in print}.* 

21. H. Fink, E.^ MacKenzie, G. Gibson, G. MatartoSki , W. Greenough and.H. \hjrr^y. 
Evolving EcJergency Care Standards for Asthcsatics, paper presented at the , 
annual meeting of the Ac«r1can College of Eoergency Physicians, Hew Orleans, 
La., Octobir> 1976. Journal of Aaerican Collegfe of Eaerqency Rhysicians. in 
print. ' ' ] ' 
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22. 6. €1bson, Indices of Severity for Emergency Medical Evaluative Studies: 

Reliability.^Yaliditjf and Data Requirements, paper presented at annual 
, ^-^oeetinos of ^fteiericaji College of fiwroency Physicians, Ck:tober, 1976, * 
, Kew Orleans, La., (Subiaitted for publication). « 

23. A. L. Kaszuba, £♦ HacKenzie, 6, Gibson, Eoergency Oepartaent Utilization 
and Patient Perception of Sy^tota Severity, paper presented at the amiual 
oeetings, APHA, Hiaai, Fla., October, 1976 (suboitted for publication). 

24. E. 6, Fiae, E. KacKenzie, J. Krischer, A. Kimball, C. Yesalis, 6. Gibson, 
The Development and Validation oj^source, Standards for the Vertical 
Ca^orization of Hospital Eiaergency Facilities, pat^r presented at annual 
Deetings of the American Public Health Association, Hiasi, FU., October, 
1976. 

25. G. Gibson, Evaluation of EKS Regional ization, Paper presented at C^EW's 
Conference on EKS EvaTuatiofl, Kew Orleans, La., -January 1977. 

• 

26. R. G, Jarron, Cahdiac Telesetry Exercise Progr^, Journal of. the Aaerican 
^ College of Eoerqency Physicians, February, 1977?5?F5E 

27. 'A. L. Kaszuba, 6. Hatanoski, G. Gibson, Hypertension: An A;idit of ^ergeRcy 
Detection and Kanageaent, paper presented at the EJeeti'ngs of the University 
Association for Emergency Kedical Services, kay, 1977. 

28. Hi Fink, B. Slosberg, G. Gibson, Eoergency Service Treateent of Patients 
with Chest Pains: A Cos^rative Analysis, paper -presented at aeetings of' 
.the University Association for Eoergency Kedical Services, Kay, 1977. — 

29. H. Fink, Wa. G. Sreenough, G. Gibson,-Strategies of Care for Patients r^X , 
Returning for Suture Reooval-, paper presented at the oeetings of the 
University Association for Energency Kedical Services, Hay, 1977. - 

G. Gibson and L. Haiesan, Walk-out Patftms ih ihe Hospital Energency Roob, 
paper presented at the neetings of the UnfV«*^ty Association for Energency 
Kedical Services, Kay, 1977. 

31. K, White, G. Gibson, Evaluation of the Patient Advocacy Progris of the - 
Johns Hopkins Hospital ^rg^ncy Departaent, paper presented at the aeetings 
of the University Association^for Energency Kedical Services, Hay, 19771 

32. R. A. Dershewitr, The Reductioa of Childhood ikHisehold l^ijuries: A JDfeonstra- 
tion Project, paper presented at the ©eeting erf the Association of ^^^latory, 
Pediatrics in San Francisco, ;Apri>, 1977. \' * ' * ^ . . ^ 

33. E^.Fine, G. Gifson, E. •HacKcijzie, Clinical Consensus in Specifying Categoriza- 
tion Standards, paper presented for the aeetings of the Aaerican Public 

, Health, Association, Washingt^, D.C., October, 1977. * , 
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34. Fink, 6. Gibson, Quality ^sess©ent \n the Eiyergency Department, Paper to 
be presented at the ©eetlngs of the African Public Health Association, 
Washington, D.C., October, 1977. 

r 

35. 6. Gibson, £. Fine, Is Baker's Injury SeveHty Scale A Reliable and Valid 
Index of Severity for Trauw Patients?, paper to bej>resented at anmi^l 
meetings of the ^i^rlcan Public Health Association, Washington, O.C. 
October, 1977. ^ 




36. 6. Gibson, The laergcncy De^risent as a Screening Point for Hospital 
Specialty Services: Inclusloiiary vs. lxc\wp^^ry Strategies, paper to be 
presented at the annual aeet^ngs of the JperlcAn f>ubl1c Health Association, 
Hashing^, D.fc.^ 0ctober^977. 

37. M. Widooe, 6. Katanoski, W.8. Greenough, G. €1b$on, Pedacycling: Factors 
Associated with Severe Injury, paper to be presented at annual aectlng^ ^ 

.of Aeerlcan Public Health Association, Washington, O.C., October, 19Z7.' 

Technical Assistance and Consultation 

in addition to publications and presentations, an leportant ©echanfsa for dlsseslnat- 
Ing research results and developed eethodologles Is technical assistance and consul ta- 
' . tlon given to EKS systems and facilities. Such assistance has included: 

^ . * 0 StateM^f Illinois Health Deoartaent (Division of EKS) ; Asslsunce. 

on data collection ah'd severity ©easures for evaluative study co^parlr^ 
wrtallty rat^ of various trai^ centers {1975-19T6). 

0 State of Pennsylirania Health DepartJDent (Bureau of Progr^ Evaluation) : 
Advice on data collection and analytic design in (Xie?)ar1ng t^je 
availability and use of hospital and aabulance emergency resources 
with selected oortallty outcomes across Pennsylvania counties (1976). 

0 Spinal Cord Center > Peoartaent of Heuroloqical Surgery, Un iversity of 
Hlad School df Kedicine and jackson hefprial Hospitals : oesign 
assistance in copparing the outcooes of patients treated at a Spinal 
Cord Center with cpoparable patients treated in non-centers, and 
evaluating the effectiveness of pre-hospital a<fe1nistrat1ofl of a 
steroid/KannltoT therapy to cord-injured patients by ambulance 
^ . ' attendants (1977). ' - ' " 

0 University of Toronto. Pepartgsent df Commity Hedicine/OnUrio Provincial 
' Soverrgent Ministry of HeaUh: Asslsunce in establishing a data base 
andTevalvatlve desi^ to assess the icpact of establishing a centralized 
- ' • trauM center with helicopter evacuation for the Joronto metropolitan 

area (19*77^. ^ . ^ 

- • 0 District of CojligtrTaT^Peoartaent of Hysan Resources (Oivislon qf EKS); 

^ • 7echn1cal'"55rntance l\survey1ng hospital and aabulance resources In 

order to designate regionat referral centers and \n establishing a 
resource InforBsation system for a proposed EKS Control and Dispatch 
center (197&-1977). . < ' 
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Washfnaton HospiUI Center Eaerqervcy Departaent and Trat^s Center. 
(Washington, O.C.j: Advice on reliability testing for clinical oeasure^ * 
of ^verity (1975-1977). 

Kltseireounty EKS Systai, State of Washington; Desigfi of clinical panel % 
case revia* of the quality of aabulance andTJbspital ew9en<y department 
care, and of theevaluation for the Robert Wood Johnson Foundation funded 
EKS cominicatlonjntervention (1976). 

• • » 

San Francisco Health Departaent (Division of EKS); Technical Assistance 
in the use of vital statistics In evaluating the lepact of the R^rt 
Wood Johnson F/xmdation fwi^ EKS interventions. 0575). 

Hedlcal Collet of Pennsylvania (Division of Urgency Medicine): Advice ' 
oh data collection and analytic oesign for Survey of Residency Prograes 
in torgency Kedicin«*(1975-1977). 

Kassau and Suffolk Counties Health Dep&rtaents (Divisions of EKS) ; Develc^ 
Dent of evaluative aeasures and data col lection ^tho^ to assess the 
isspact of the Robert Wood Johnson Foundation fimded EKS interventions 
(1976). ^ 

Westchester and Surromdiyj Counties Health OepartsCTts (Division of 

EKS) : Development of evaluative aeasures and data collection aethods to 

assess eaergency sedical services (1976). ^ r 

John Andrews Hoscfital, Tuskeegee Ij^tltute^ Alab^: Technical assistance 

in measuring esjergency department non-urgent usage health status for A 

an evaluatiye -stlidy which is exasining whether an outreach pricsary care 

.prograB (m/rse practitioner, protocols and flobile trailers) reduces the 

non-urgent use of hospital eaergcncy depart©e?)t and offers equally' 

attractive, tieely and econo»1c care to ryi^l Alabaela^tt {1976-1977). . • 

East Hichioan EKS^ Inc .: Technical assistance in data collection, design ^ . 

a3*d In making severity adjusted* aortality rate toeparisons for trauca' 
patlenU' treated at several eastern Michigan Hospitals (1977). 

State of ter yland Health Deoartaentr nivUlon of EKS): C<iding, data 

proccssir-^ ^ ' ' . - . . . - 

to descr 
Raryland 



jt^uc i>t f^nriflJiy n eaitJi i/gpartagTu^t Division of tlO}: Coding, 
proccssing\nd analyjis (under contract) of 47,936 ar6ulanbi>rtm rep*>rts 
to describe \he aiount ^nd nature of asbula/>ce utilization Mn .central 



0 Research Coraittee, ^rican Col lege of Eaei^«K:y Fhysici^s: Assistance 
in develc^lng questionnaire to ACEP ©eabershlp on eaergen^ iepartaent 
- ^ _saQage«ent and ea^ipoifer and EHS systea involtesaent and in evaluating 
proposed res^earch-prpjects for ACEP .fw>ding. • 

•In addition^ prograa sj^ff has offered si^tffcant EKS technical assistance and 
consultation to the national Center for Health Services Research, the ftational 
Heart and Lung Institute;^ the l^tional Aoade^ of Sciences, the Mitre Corporation, 
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JRB Associates, Arthur Young and CoEspany, the Bureau of Health Resources and 
Oevelopeent. the Division of EKS (EKiEW), the Orkand Corporation, the Assoclatl^ of 
University Prograas in Health Adelnlstratlon^ the Kavaho Health Authority, the 
Energency Department Kurses Association, the University of Cincinnati School of 
Hedlclne Eeecaw^cy Kedlclne Residency Prograa, University of Virginia Emergency 
Hedlclne' ResTdency Program, University of Washington study of pre-hospltal cardiac 
care. University of Florida study of EKT performance. State of Io« Health Depart- 
oent (Division of EKS), The CenteNfor the Study of Urgency Health Services at the 
University of Pennsylvania, the Un^erslty of low Health Services Research Center, 
Heakh Inforwtlon Technology Services, Inc., Oeaha, Kebrasfca, the K1a«i VA Hospital, 
and the Johns Hopkins Hospital Departaent of Anesthesiology 
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TITLE ; EMS Severity ,^nde;i Research ^RANT NUMBER : 1 R18 HS 02621 

GRANI£E INSTITUTION : University of Wisconsin 

PRINCIPAL IWESTIfiATOR : - , FUNDING LEVEL : $177.864 ^77 

David H. Gustafson"^ Ph.D. 

Professor and Director 

Center for Health Systems Research 

,oo[?^«f"^^^^^'^ - TOTAL PROJECT PERIOD : 7/01/77- 

1225 Observatory Drive ' 6/30/79 
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Madison,"* Wisconsin 53706 

(608) 263-4883 ^ 



SIGNIFICAfi'CE : " 

With the investment of significant amounts of federal dollars in the 
efuergency medical services area, there is conM-defable interest in 
developing measures of the effectiveness of thei^ .programs . It is 
important to have some rational basis for a variety of strategies and 
approaches to allocating resources for systems. As the- Emergency 
Medical Ser vices Research Program Solicitation , issued in 1976 by the 
National Center tor Health Services Research, stated it: 

"Attempts to measure adequacy of EMS systems must insure that 
coeparable groups of patients are being studied. . .Separation of ■ 
patients into categories such as emergent/urgent/and non-urgent 
IS not precise or reliable «noug}i to permit comparisons o'f 
different EMS conditions. Accurate methods are needed, therefore, 
to describe and classify patients with regard to degree of 
severity of their presenting complaint." 

The classification of patients according to types of conditions and their 
severity 1s a necessar/ avenue toward developing some measures of effective- 
^less for use in evaluation. Some work has begun to show promise for certain 
well-defined conditions. A way to determine severity scores for -patients 
is clearly necessary at this time for successful evaluation of EMS systems, 
.and that method must be erpplicable to many conditions, acceptable to 
providers, and useable in a variety of settings. 

PROJECT DESCRIPTION : , ' ; 

^ther approaches have attempted to develop severity Indexes by collecting 
large .amounts of data, but these have proven to be expensive. This research 
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avoids expen&ive data collection efforts by employing procedures which use 
the judgments of medical experts in determining levels &f severity. In 
the past thirty years, there has been cqnsiderable development of techniques 
which use experts to set priorities and determine the relative inroortance 
of factors in complex judgmental processes. These methods have been 
systematized and have proven to be reliable. In this project, these 
techniques are applied to the development of severity indices for the first' 
time on any major scale. In experience with these methods in other areas 
of inquiry, the derived agreement. on factors and relative scores has be€^ 
significantly high. As a result it is anticipated that similar success can 
be achieved for severity scaling of EKS conditions. The approach will be 
tested for reliability, sensitivity, usefulness anfi acceptability to physicians 
in emergency medical practice. ^ 

This study will devise and test two severity index development 'methods, derive 
severity indices for two EHS conditions, and d^onstrate theVtiljty of the 
index in classifying patients for evaluating EHS systems. During 'the period 
of this grant, indices will be developed, the strategies used in their 
development will be evaluated, and personal characteristics of the index . 
developers will also be evaluated. The conditions for which severity 
indices will be developed are cardiac conditions, intracranial/spinal 
cord injuries, drug overdose/poisoning cases, and abdominal pain. 

The actual index development will utilize three panels of five physicians 
each for each conditiorr. The panels will operate independently of each 
other. A Delphi procedure will l?e used to develop a list of factors which ' 
would servle^as indicators- of severity prior to the panel meeting. The 
panel will assemble in the evening^f which time a set of variables will 
be extracted from the list. A computer program will then be used to ^ 
generate 30 test cases containing possible ranges of th§ variables in the 
set. • 

Two 'types of utility models will be employed: 1) a self-explicated modej, 
wherein experts identify factors to consider, estimate the relative 
importance of/the factors, and use utility theory to ^translate all factors 
to a common Measurement scale, and 2) observer-derived models, wherein 
experts estimate severity of cases presented and regression analysis is 
used, to mod^l their behavior. 

Once the indices are developed they will be tested utilizing a sample of 
abstracts and medical records. Data are Ivailabl^through the State Health 
Department which include computerized ambulance trip reports,, tied irvto 
an ED data syst^ (primarily designed for'billing and management purposes) 
and then linked to inpatient abstracts. 

Jhe four criteria'that will be used in evalliatirfg the severity index' ^ 
strategies are reliability, utility, sensitivit3r, and acceptability. 
Reliability will be tested By ccMpparing models matf4 by different panels 
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ana by the' same panel -at two different times. Specialists-will independently 
create patient pV-ofiles that span the range of. severity. Thirty of these 
proflles.will be rated using each of the panel models and the cor»%lati6n 
\ of ratings between the five^elf-expl icated .panel modeTsiirfll be compared 
J to the correlation of ratings of the five observer derived models. The 

test-retest reliability study will use three of the five panels in a secorvd . 
conference 3 months 3ater. D&U to be used in development of models jwill be* 
• collected from hospitals representative of different categorisil Patient 
outcome information collected 3 to 5 ntonths after a patient iHfcft the 
EMS system will be compiled. j J^^^" 

Predictability will be studied by convening a panel of physicians to review 
120 abstracts and charts of a sample of actual patients within one condition. 
Data on everything. bat cost and outcome will be made available to the review 
^ panel, who will th#n rate the severity of the patient at the time of the 
first contact with the EMS. Severity estimates made by reviewers of tbe 
patient record SBstracts will be correlated with the' severity index scores 
for the same patients. (Utility will be studied by determining whether 
'differences -in -care between Tr^titutionaT types can be detected when patients 
are first classified by the severity index into comparable 'groups. The 
panel which has been used in studying predictability will be asked to rate " 
.the acceptability of care proyixie^ to those" patients and the ratings will 
be correlated with institutional type. 

Sensitivity will be studied based upon the use of three sets of weights 
for each factor which has been developed by the panels: "best estimate" 
and values to be considered high and lijw. extremes. Acceptability will 
• be assessed by two panels. for each condition of persons who are • 
influential .in the medical community in the state, but who have not 
previously participated. . They will be askeji to review the process by 
which the indices are developed, thg index itself and data on its 
reliability^ utility and sensitivity., 

Utility of indices in evaluation will be studied through cross-sectional 
and longitudinal evaluations of process and outcome for the 'test condi- 
tions. The sev.erity indices will be applied to determine if the index 
Identifies significant differences In EMS systems. 

The personal characteristics, of i^dex developers will also be- evaluated. 
Included are the e£f€cts of specialty, Institutional setting,' and conflict- 
resolution style. , , ; 

PROGRESS : 

This is 
a staff 
the fal 
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and practice, physicians and statisticians, and has accessUo physician 
panelists, experienced in emergency medical care, through the State EMS 
Medicai Advisory Committee." 

DISSEHIHATION OF RESEARCH RESULTS : . 

• It is anticipated that evaluation of EMS by usin^ this index will be 
tested within the State" of Wisconsin, Should the method prove practical, 
other conditions, beyond the two employed in this study, will be added 
to the list of those scaled for severity. There will also be detailed - 
reports and active dissemination strategies attempted with other states 
on applications of the metfiodsVor use within those jurisdictions. 

T|)e research is significant locally, regionftly, ^and nationally insofar 
it advances the state-of-the-art of severity index J^velopment. 

The emphasis is on a "transportable" index development methodology as 
opposed to arriving at indices which ca.n be utilized nationally. The 
intention is that the methods developed can be used on a national level. 

Host methodologies for the development of indices of severity have 
attempted to closely appro^dmate "truth," as opposed to "consensus." The 
empI!Srsis on "consensus" wilnenhance the usefulness and acceptability of 
the indices for ongoing evaluation locally. 

A strength of this project lies in its methodological development. When 
completed, it will provide a defiivitive study of the solicitation of 
. .judgments from expert groups. Although different sevefity indices may 
be developed by individual panels, tijeir predictability and reliability 
will be quite similar. Once the methodologies have been refined, it 
will then be possible to construct .a state or national i^dex in a very 
short time utilizing one additional parieK Consequently the research 
will provide#uch insight into the usefulness,' reliabil ity, repeatability 
and validity of the expert panel judgment process. 
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SIGNIFICANCE 



This IS a multifaceted study concerning the effectiveness of certain aspects 
of ot/t-of-hospital emergency care. The study ^emphasizes the assessment of 
bystander- initiated cardiopulmonary resuscitation and the evaluation of 
training programs for this purpose. Because of the obvious need to avoid 
delays in treating cardiac emergencies, participation of bystanders in the 
initiation of cardiopulmonary resuscitation is likely to be a critical factor 
in reducing mortality in patients with cardiac arrest. In addition, this 
project IS seeking answers to basic questions related to the effectiveness 
of emergency health, care;, e.g., what is the effect of early care on morbidity 
and mortality in acute myocardial infarction, and what effect has pre-hospital 
care had on mortality rates? Finally, the investigators are working to 
define the requirements for .drugs uSed to correct acid-base balance administered 
during cardiac arrest. Alkalinizing agents are commonly given during resuscita^ 
tion. there is reason to believe that currently reconmended dosages need 
revision. ■ ' 

PROJECT DESCRIPTION : * - 

In this three-part project, the investigators are examining the value of train- 
ing the public in tlje .techniques of cardiopulmonary resuscitation. This 
problem IS being analyzed in terms of effectiveness in improving patient out- 
w??^\.IJ! 3lso examining all hospital admissions of patients 

with acute myocardial-.infarotion to th6 major Jiospi tals in Seattle during a 

■?!!roSLf^''i° • J^- 5^'°'' °^ ^^^'^ detailed evaluation is to assess 

the effect of early intervention^ for acute myocardial infarction on hospital 
morbidity as well as mortality. ^ un nubpiwi 

The third phase of the study concerns the definition of requirements for 
alkalinizing agents during cardiac arpest and is being car>Ld out by monitor- 
ing acid-base balance in patients during the course o? resuiCltat on o^s de 
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tbe-ttospital . A special blood gas apparatus is transported to the scene of 
resuscitation, and blood samples are collected for determination of the amount 
of ^Ikalinizing agents to aj^inister. These data are subsequently related to 
the clinical conditions at the time. The purpose of this work is irHimately 
to develop clinically useful guidelines for the use of bicarbonate injections 
in resuscitating cardiac emergencies. ' — 

PROGRESS ; ' . ' 

♦ 

To date, the study has* shown that bystander-initiated. CPR is associated ' 
with an approximate two-fold increase in-jnitial, survival and with significantly 
lower-hospital morbidity when treatment fCT- ventricular fibrillation is begun 
outside the hospital. With the ava.ilability of good quality advanced life- 
support in the field, appjTOXimately 40% of patients found in ventricular 
fibrillation are resuscitated, brought to the hospital and ultimately discharged 
home when resuscitation is initiated by a bystander. In bystander-initiated 
CPR, hospital morbidity after resuscitation is improved, probably because of the 
protection of the central nervous system through promptly administered CPR. 

The CPR training evaluation is about half complete. A sample of .150. persons 
trained six months previously has been tested for competency. Preliminary 
results show that about 80% of those trained achieve adequate levels of CPR 
performance. . Further ttesLti/ig will bo. carried out on a group which were trained 
one year previously. Of these, half will already have been tested at the six-. 
mont|i interval. If the latter show improved performance, it will suggest that 
the test itself, with the feedback which is given to those test'ej, has beneficial 
effects, and could be a practical continuing education method. 

The blood gas study will be able to achieve a larger number of observations than 
previously planned because of installation of the test equipment on a separate, 
nonqiedjcal vehicle, thus increasing mobility. Data collection should be 
completed by Fall of 1977. 

DISSEHiriATIOH OF RESEARCH RESULTS ; 

R.G. Thompson, R.E. Haynes,"and L.A. Cobb. Hypokalemia in patients resuscitated 
from out-of-hospital ventricular fibrillation. Annals of Internal Medicine 
(in -press), 1977 abstract. Presented to the American College of Physicians, 
April 19, 1977. ^ " * 

L.A. Cobb, A. P. Hallstrom, and G. -Harris. Determinants of outcome in patients 
.with out-of-hospit&T ventricular fibrillation. Presented to the Associa-tion 
of University Cardiologists, PlroenyCi Arizona, January 21 , 1977. • 
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SIGNIFICANCE : . 

The primary purpose of this investigation is to evaluate the quality and 
effectiveness of the care provided in specialized burn care' facilitii 
and to develop appropriate standards to improve burn-[5kient care. h\ 
current -scientific basis for the attainment of excel lence. in burn medifcine 
for both emergent and long-term care will be establi'shed. This is bei/ig 
achieved throuqh the analysis of the data of the National Burn Infwniiation 
Exchange (NBIE) and through site visits to leading burn care facilities 
The methodology developed will be useful for the evaftation of (other 
emergency care procedures. The results of the study will be heVpful to 
burn ^:are physicians and investigators concerned with the use of medical ' - 
registries for the evaluation ^nd improvement of patient care in other 
settings, including traumatic emergency settings. Medical registries are 
important for gathering understanding of the clinical aspects not just of 
burns, but jDf a great many serious and complex conditions. They, allow 
the collection of umform data on large numbers of patients so that efffects 
of many variables, including variations fn care, can be examined empirically. 

PROJECT DESCRIPTION : • 

The research plan for this investigation consists of a sequence of inter- 
related studaes whici ilTvolve comparisons of burn care institutions with 
respect to mortality and other outcome variables in order "TO^ determine the 
extent to which different resuliii^re associated with various procedures 
for patient management apart from institutional artd patient characteristics. 
These studies are as follows: 

11 A Retrospective Institutional Drfferences^Study consisting of 
. a comparison of the results of/burrf treatment in eleven major 
facilities on the basis of aat/a submitted' to the NBIE and data 
obtained from the next study;/ 
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2) An Institutional Review Study consisting of the design, implement'a- 
tion and analysis of on-site i*eviews of these same institutions; 

3) A Prospective Institutional Differences Study consisting of refine- 
ment of the data gathering instruments and pro'cedures, th? evalua- 
tion of feedback to the institutioivs in the Retrospective- Study, 
and extension 'of the study to other buVn care facilities. 




PROGRESS : 

J 

The followirr^ goals for the current second year af this investigation ar£ 
neafing completion: V 

to complete a Retrospective. Study of eleven -major burn care 
\ , facilities* with data submitted to the National Burn ^Information 

\ . .^Exchange (NBIE) in order -(a) to explain insti tutioaal differences 

) * ' in survival rates and.(b) to develop new baseline curves for / 

patient survival relative to several progfiostic variables; 

2) ' to design and implement an Institutional Review Study primarily 
through site'visits in order (a) to evaluate the quality and 
effectiveness of burn patient care, {b) to develop standards for 
^ ' * burn care and, inv^onjunction with the Retrospective Study, (c) 
- . to explain insti tup<}nal differences ir\.the outcomes of care; 

/3) to evaluate, the Current NBIE jdata gathering instrument and 
procedures; / 



V 



4) to ^vicfe guidance on the bse^'isf other" registries for the 
evaluation and improvement of patient care> ^ 

Statistical methodology and computer programs have been developed for the 
Retrospective. Study and preliminary analyses have been obtained. .The? 
methodology fif on-site evaluation of the organizatfofi^Ml delivery of 
specialized burtn care 'has been developed, all site yfsTW have been completed 
and analys^is ofl site-visit data ir underlay. Additional hospital, participants 
have. been tpalfted for.,entry into the project next ye£[r> Feedback to directors 
of institutio/ls who are currently pa1;tic1pating was\comp]e£ed during a June 
me^ng.. I'ff^Jegrafion of the data, from the RetMspecVr^^^and Iristitutiohal \ 
ReviBw studiM 1s underway. . 

DISSEMINATION DF RESEARCH RESULTS : . . ' • 
J— : ^ ^ 

Drafts.of several technical refSorts 'are nearly cdflp.leted. Tfaese reports were 
reviewed by the directors of the particlpatlngMnstituttons 1n June and final ^ 
reports will be available $Hoftly thereafter. • • 



The topics of the reports under ^)reparati on, the' corresponding goals they , 
pertain to and' summaMes^of thfir eofitent are as follcwsr 
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'l) • Statisti cat methods for burn studies TSee GoalsJ(la) .and^'pb)] 
j .Methods of ^n^lysfs for burn patientida^a are reviewed and 

: ; illustrated. Univariate data 5niooth*^«techniques such as'probit 
anal^sis'are described. The multiygriate technique's applied to* 
this study, which take into account -man^ -explanatory afid prognostic 
^ variables', are presented and their contribution to the understatiding 
( of burn- survlva.1 is discussed. \\ 

2; Institutional differences among burn facilities [See Goals 

(la) and (2c}J A statistical ^est for irwtitytional di f f erences 
in survival experience att^r adjusting for age, percent tptal burn 
. •''^(18), percent , fun-thickness burn (FXB), sex, year of burn, time. 

from burn to admission and trachedStemy has Udfen -developed. The ^ 
survival rates diff^ by a statistically signift cant amount. - Tbe 
estimateji differences in mortality aftef contnolJing foK these 
• variables: are large-, two-fold differences; irt^sdr^ival ^rk estimated 
betwe^ some of the institutions studied, 'y^ ' \ 

3) Factors affecting burn survival [SeeJ^oals (Tb)'and C2b)"] A 
model for the survival of a burn patient has been develop^ed 

• based on severity and on demographic and treatment varijables, 
and has been used to assess which variables most crucially 

• affect burn surviv^ A multiple logistjc model for survival 
' probability has be'en developed based on th6 set of variables 
listed under- it€m (2). The most crucial predictors of survival 
are age, TB, FT6, and time frcKn burn 'to admission. A simplified 
^ predictive ijfodel which can be used by the- medical practitioner 

has been formulated. . ^ 

4) .Eyaluation of the quality of the mit data b^e Goal 3)' 
The data base has been evaluated in terms of cosi^eteness, 
selection bias, and validity. -Particular attention 'has been 

- focused on the percent fuU thickness burn. ^ 

■* - ^ ^ . 

5) Description of characteristics of burn patients and bum care 
[See Goals 13a; and (3b)J For each institution, a profile of •. 

the patients has been prepared 'giving a comparison of different ' ' 
types of institutions on the basis of the age, sex,. race, size of 
burn^ and other important v^iables recorded In the NBIE. Included 
are profiles prepared by cau|,e of death and types of complications. . 

6) The utility of data registries CSee Goal 4) The utility of voluntary 
data registries is discussed. StaJ;istical'implic-atidnr of non- 
random data acquisition and stwd'ardization. of data reporting have 
been e)*plOred. Genera Tizatioris- will be made of^the- results' of the 

•♦ investigation of the burn study to other registries. ^ • ^ 

• ' 7) On-site eva luations of burn care fac^ilities fSee Goals f2a). (2b) " 

and (2c)J T^e site VT^it metfiodo\ogy and findings will b6 presented 
and discussed. These results^wiu; aJso be' incorporated into the 
analyses described inVeports (3), (4), arid (5). '. 
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The -foil owing publication by project participants reports upon the baseline 
for this research: ' 

I. Feller, J'.D. poTlT, and R. Bawol. "Base\jrie Results of Therapy for 
BurnetJ Patient 
(1975), 1943/^1 




BurnetJ Patients/" Journal of the American Medical Association 235 
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The purpose of this research is to evaluate the' performance of specially- 
trained .police officers serving as rapid-respomler^ in conjunction with 
an existing Emergency Medical Services (EMS-) system. (The response of 
these police officers for the purpose of\dminist?rihg. first aid" procedures 
prior to the arrival pf an ambulance is. referred to* as the medical aid 
vehicle (MAV) concept.) Examination of the police MAV concept will provide 
insights concerning the d^s4rability of . incorporating police and other 
pyblic safety agencies l/ito Jhe EMS system, as the EKSS Act specifics. 

The significance of thirTesearc/fTcafn be seeR irvthe many areas of the 
United. States which do not have the funds to insure that wel 1 -equipped and 
well-trained emergency resources are always readily available. All of these 
areas, however, Jiave some form of full-time piybltc -lafety resources, including 
county or state police, county sheriff, or other law enforcement personnel. 
The impact of this researth, in terms of the "types of conditions most freque^^ly. 
encountered, types'of training experiences of gr^test benefit, and' the general 
ability and willingness of police officers to perform, fi rst ^1d duties will . - 
greatly aid planners in [providing broad-based decentralized emerqeitcv services 
as efficiently as possiUle. • / ^ ^ . . - 

PROJECT DESCRIRTION : - . ' ■ 

Overall objectives of this research Include the following: (1) to analyze an^ 
existing police trauma-management training program for ttte purpose of 
describing medical skiHs taught to participants; (2) to describe the tasks 
or groups of tasks, from the existing training progpam which should be per-'' 
formed for spfecific,, individual medical emergencies; (3) to detemlne the 
frequency with which pol.-ice perform specific HAV tasks and other non-medical 
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tasks in a -functional MAY environnfent; (4) to asses-s the relationship between 
police perfomahce on HAV, skills and performance of "traditional" duties 
associated with law enforcement; and (5) to -measure attitudes and perceptions 
of the police officers'- with Regard .to the HAV concept/ 

The research setting is DeKalb County,. Gey^gia, one of the central counties 
in the Atlanta Metropolitan, area. OeKalb County has a total population pf 
464,000. In over one half of the land area of the county> ttfe population 
density is only IIDI persons per sfluare mile, with 4.5 persons per squar^ . 
mile- in the urban areas. The OeKalb-County Police Departoent (DKPO) has 
'required all new personnel to undergo first aid training as part of the 
police acad^y training program for several years. The present first aid 
program consistsuOf forty hours of instruction and practice* Satisfactory 
performance in tnis course is mandatoryx • Emergency aimbuiance service for 
DeKalF County is primarily provided* by ^ the DeKalb County Fire Department,-, 
which has a close wortji'ng relationship with the police department. 

The evaluatiiPn of the KAV concept is focused upon the performance by the 
police officer of a set of prescribed first-aid tasks based upon the 
condition of the patient. Related to the tassessment of first aid "performance 
is the perfornjance of non-medical^ or "police" tasks, required at the scene 
of the medical emergency. These fir^tr-aid and police tasks have been assigned . 
ni^i^'c'weights developed by modified flominal Group processes using panels 
of medical and police experts, respectively. The accuracy of the patient 
condition determirration (or diaffiosis) made bj^.the police officer is checked 
by comparison Co ambulance run reports f>led by the Fire Department on each 
case. An overall score is commuted for each case based upon weigh'ted task 
completion by the officer renjlering assistance prior to EMS arrival. Cumula- 
tive scores are being developed for each officer based upon the total casds 
encountered by the officer. These scores are being computed with weighted 
alCowances made for conditions at the scene which might •influence the officer's 
performance, f^erformance monitoHng at the scene is conducted by. the project 
syMi using a randomised sampling plan of the individual sectors knd shifts. 

The effect on performance of Intervention ttme (primarily the time a^vailable 
Ito the afficer before piS. arrival), thet relation^^^ between fir^t^aid task 
performance and police task performance, and the interr^relationships among 
the behavioral variables and between task 'performance &nd behavioral variables^ 
•are being examined and analyzed as well. , ' * » ' \ 

. PROGRESS : ^ . \\ , \ 

" " ' • . ^ * 

Progress to date includes: (1) the analysis of the polic^ first aid trafning- ;*/ 
F program, (2) an aittly&is of police operations specifically related to the 
, performance of initial emergenqy care arjd documentation of the comfiHjnfcation ' 

interface between the police department and the fire department which op'erates V 
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the eMs program, (3) the development of a series of specific first aid tasks % 
to be performed for specific medical conditions based upon the content of the 
training program, (4) the. develofxnent of "^series of pol iee-related .tasks 
which are coomonly performed. at the scene oKa medical emergency depending 
upon the setting, (5) the development of -weights for both police and first aid 
•tasks based upon the relative importance of the tasks,-according to certain 
medical emergencies, (6) the* identification of various conditions at the scene 
of a medical emergency thought to influence the officer's performance (via 
the Delphi technique), J7) an analysis of actual police-related medical 
emergencies to dejtep»i^ie the- frequency of occurrence for various types of 
emergencies-, (8) tfte^design and test of .an incident form to be canpleted by 
each 4?olice officer involved in an emergency rt^dical situation along with a 
data reporting and monitoring system, and (9) the development, admini strati oj3. 
and analysis of questionnaires to measure attitudes and perceptions of the: . 
police officers, 

A computer program to ana.lyze the data collected over a twelve-month period 
has been developed and is presently operational. One of several preliminary , 
analyses permits comparisons such as response time of- the police first responders 
vs. the EMS system. Of the 4,000 cases captured, 24'i-of the calls were in the 
rurji section of the study area. Response times in the rural areas averaged 
5.85 minutes for the police and 7.94 for the Fire-Departr.ent dispatched - . 

EMS vehicle. In the urban areas, the response times were 4.99 for the y ^ • 
police vehicle and 6.96 for the EMS vehicle. Response time is defined as" 
time from dispatch to time of "arrival on the scene of the emergency. These 
preliminary results strongly .suggest. the potential, maximal value of this 
concept when applied to rural settings where response tir^ and low population 
-density are;p^ticularly important considerations .in the delivery of emergency 
medical services. The results of the completed analyses of data from this- 
study will be available in the final report which is duatin the Tall of 1977 

. ■ ■ ' 

DISSEHIFjATION OF RESEARCH RESULTS: I 

R.Cochran and J. Hyrick, ^"Effects Of Advertising Upon Emergency ^ 
Aid Seeking Behavior," -To be presented at the Annual Meeting of APHA 
October 1977 - Washington, D.C. • 



j. Hyrick arid R. Cochran, "Attitudes and Perceptions of Police 

n^^!J21"Vf^^^7«?^ "/^J.A^^." -To be presented at the Annoal Meeting 
or -APHA ^ October 1977, Washington, D.C. , ' 

J. Pittman and C. Thomason, "Quantification of the Task Performance 
of a Uniformed Police Patrol Officer: A Group Process /fit)proach," 
Socio^Econ omic Planning Sciences -facceoted for publication) 



Justin A. Myrick, Ph.D^ ^ ' ' 

Staff Working Papers resulting frooi this study include: 

"The Performance of Police in Medical Emergencies" . 

"Use of Police First Responders in Medical Eniergencies" 

"^he Development of a First Aid Performance^ Index for Police Officers: 
Ti Group Process Approach" 

Additionally, several papers will be developed for publication when the 
analysis phase- of this project is completed. 
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•SIGNIFTGANCE: • • . 

This is a "large-scale comparative study of hospital emergency servi<:es 
(HES). Its main purpose is to describe the organizati&n and assess the ■> ' 
...l^^sctiveogss of-ejisrgency cifce deJjvery units/departisents^ Asf^ects of • 
effectiveness frhicfi are being considered include economic efficiency , the 
quality of service or clinical efficiency, responsiveness to ccagiUntty 
ex peg ty: ions, and s^ff and patient satisfaction . One major objective is to 
examine the nature and soui^cas of mter-hospital differences in eniergency 
service effectiveness. Another i.s to specify those organizational factors , 
and conditions which pranote successful probleci-solving and facilitate 
effective performance in^HES. The underlying question is,- "What makes for ' 
an efficient and effective envergency service — h>w can HES imppove theit 
organization and make n^re efficient usfe of their resources jn- order* to 
better serve their patients and improve the quality of care?" 

* • 

This study is 'likely to mak^a significant contribution to understanding . 
and solving the problems of organizing and operating snergency ff«dical 
services. The project's contributions' are expected to go well beyonfl their 
ifiKiediate value to those energency services and hospitals participating in 
the effort. The concerns of the project focus on the single most important - 
question in .the field •— the question of the effectiveness of'the health 
sefyices delivery system.. Given the difficult problens new permeating the 
system at all level-s (and the burden that these entail for patients, the 
public health professionals, and government policy makers), this 'type of 
research seems not only desirable but essential. 

, There is; a pressing need for high-qual ity/ problenj-focused reseaVch in the 
areas of energency and ambulatory care that addresses current cajor problens, 
and especially those problems about which available dependable knowledge is 
grossly limited. Host notably lacking is i-eseargh going bfeyond' single case ' ' 
^S^hl^i^"'' tackling the probleiins of. en^r^ency service systems with a-ngorous ' 
scale that is commensurate with their ^gnitude and c(y^plexity 
base and Hn" ''''''''' which-reliefon .a so6nd tS? " a 1 

nr^-co J 0" cc^tiparative designs and scientific sampling holds tfie greatest 

z^eiii: - - sciJifiLii,. Tts^^^^i::; 
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The 'empirical data on the organization, functioning, and effectiveness of the 
dominant sourc? of en>ergency care in the* pountry — the hospital emergency 
service — remain at a primitive-state. The problems and difficulties now 
being e^xperienced are appreciated and even lamented, at leKt from a practical 
standpoint and in terms of undesirable outcomes. However are inadequately - 
understood in terms of t^ieir ongins^and correlates, and even more poorly ^under- 
stood in term's of their intertelatiOnships and likely solution requirements. 
Especially missing is xlependable knowledge about the factors and ct)nditions 
(many of which potentially could be control! ecJ^by the system) which facilitate 
or hinder the effectiveness of hospital' energency service <iepartments in its ^ ' 
major aspects — the quality of cane, economic aod social efficiency, patient 
satisfaction, and responsiveness to ccxmiunity needs. The present .p<3Dject is 
designed to fill thi^ gap. ^ , 

Also missing is dependable .knowledge about intec-ho^pi ta^ differences in HES 
effectiveness arfd their sources, arid especially the'tr sources in the nature ♦ 
of HES organization and organization functioning. This {project focuses on both 
'or-ganizational variables and effectiveness criteria, relying not only on the 
most u-seful assess^jient techniques^>ava|'lable, but also on nen and pranising 
approaches. The research has tfte potential, therefore, of baking a significant 
me tl^odo logical contribA>tjon in addttion to producing much needed factual know- 
ledge about the substantive prbt^l^'of urgency. services on which it fociises 
and making availaixle^, for'^£^-£iKst liF^, meaningful norms against Which -ho^ita Is 
could compare their. own HES si^uatYcn. Finally,- since HES represent a certain 
type of organization about which current theory has v^ry, little to offer, the . 
study has the potential of making aTv- important contributi<)h to the broader field 
of modern organization theory as well. 

The finjdings will be directly useful to hospitcils and their emergency service 
units, to emergency physicians, nurses, and technicians, and to hos-pital 
Administrators. In acfflition, they should be 6f 'value to Hpalth Sj^st^s" Agenc\es 
and Professional Standardsl Review Organizations', to those responsible for 
trailing emergency service/ personnel , to policy makers, and to researthers. The 
results will be us^l to these groups in at least three^ifjportant ways. First, 
the stud;^ will provide heretofore unavailable fartual knowledge and* meaningful 
"^norrfis" against which parti ciiiar" HES' situations can be compared ajid assessed. , 
Such "bencteark** data will b^ generated for various- criteria of HES effectiveness 
{including economic, social/ and clinical efficiency) as well^s for 4mportant 
organizational variables Ke.g.^, cooriiination, 'resource allocation, adaptatidnj. 
These data can be useful for identifying and resolving problBns within an HEbT* 
setting goals and objettives for the HES, and fm)tivat^ng the fndividuals involved 
to initiate constructive changes to improve the effectiveness of ©nergewry" ^' 
medical -services. ' ' - 

Second, the study is designed to identif>^ the organizational pattern? and 
characteristics which are associated with HES effectiveness. - These results can 
be useij^y hospita] policy makers aod professionals to idehtify arid implement 
thpse su^uctural, teclinical, and/or staffing changes which are most likelj to 
improve the effectiveness of en^rgency service units. ' 
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Third, the study will be usefuT by extending to,i^ES•a theoretical formulation 
of organizational behavior that is nx)re applicable than othei^s which currently 
are available. Existing models of organization do not adequately , explain 
the behavior of complex systems such .as the HES and,- therefore, fail to 
provide a bas|s for generating innovative structures and processes which could 
improve emergency services. Our study is -designed to generate relevant concepts 
and theory that can b^pplied directly to analyzing and resolving the problems 
that emergency sefvicesV^ce. 

PtfejECT OESCRIPTION ^ ' ' 

This study is designed to: (1) (Je.scribe the resources^ structure, and work 
requirenent* of HES; (2) ascertain ttie major strengths 2nd weaknesses, problems 
and needs, and goal fxrioritier of HtS^ and examine these in the context of the 
environment within which different HES's operate; (3) estitna.te the relative 
organizational effectiveness of HES {tJS^ing several techniques, including a *' 
matrix of selected patient conditions, to obtain both quantitative* and qualita- 
tive measures), and analyze inter-hospitat differences in effectiveness; 
(4) identify organization patterns and social-psychological conditions associated 
with effective HES performance', and test certain hypotheses of practical and 
theoretical interest in the process; and, based on the preceding, (5) provide-' . * 
each participating hespital with factual knowledge and meaning'ful "norms" against 
which to evaluate its owr) emergency service situation (e.g.', canpare itself to 
the average for hospital/ of the sar% type, size, etc.). — ' 

The study focuses on a significant segment of the hospital population —'the 
nonfederal, not-for-profit, short-stay general hospitals in the 100-499-bed 
range within HEW Region V (Michigan, Ohio', Indiana, Illinois, Wisconsin, and 
Minnesota) which have Emergency Departments. A total of 436 hospitals which 
meet these criteria will be represented with a, scientific cross-sectional- sample - 
a ten percent stratified (by hospital location', size, auspices), controlled- 
selection, probability sample. The sample, new drawn, consists of 44 hospitals 
whose emergency departments will be studied. Data will be obtained frcwn 
administrative staff, physicians, "'nurses, recent patients, and s'elected^Tn^vidual 
iji the community, fro:n hospital records, and from supplemental sources. The 
data will be collected at each srte i/i the fall of this yaar; ^ 



PROGRESS; 



The research is progressing satisfactorily and on schedule. One major ac^nty 
durifig the first year was the-elaboratlon anHJ-efinement of the research plan. 
.In this connection, many impor^-ant practical, conceptual, and theoretical 
issues were carefully examine/J'and res-olved, and in-depth working papers concern- 
ing the principal areas of research interest were prepared. _Jhese papers focus 
on: (1) the coordination of stjff efforts within the HE^; (Z; the allocation of 
ava^able resources (staff, Mids, information); (3) thg adaptation of HES to 
the external environment and relations with the local community; (4) the economic 
efficiency of the HES; and, (5) "clijiical efficiency," or the quality, of emergency 



care. 
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The research framework, which views the HES as a complex work-performing 
and problem-soTving system, now has been perfected sufficiently to permit the 
development of the necessary data collection ifistruments (a task now underway). 
As the work on such issues as, for example, economic and cTTnical efficiency/^ 
has progressed, specific procedures for measuring thes^e variables have been / 
identified. The research model being used, with some modifications, can also 
serve to provide hospital personnel wiih an understanding of thV organizational 
factors critical to effective performance' on the part of emergency' services. 

Other activities during the first year included revie'i^ing the relevant literature 
on hospital emergeacy services, selecting the sample of hospitals to be studied, 
and gathering prelimiaary data, about the 44 hospitals in the sample. 

Work to date has. been aided significantly by the inputs of knowledgeable 
researchers and practitioners in the areas of economvc ^iciency, organizational 
processes, and quality of care. Additional ly, the investigators attended the 
recent Emergency Medical Services Conference in Atlanta and have visited HES 
^*tes in order to gain a better understanding of the probl^s faced by'practi- , 
tioners. Finally, t)iey have, met wiih key representatives of the American 
College of En'ergency Physicians, the American Hospital Association, and the 
Ajnenican Medical Association. These 'contacts ffave proven fruitful in helping to 
formulate th^ research in a way that is both scientifically and practically 
freani^ilgful.. They are expected also to be helpful in securing th| participation 
of the hospitals in the sample. In the near future, they will be holding similar 
^discussions with the Emergency Department Nurses Association, the Arierican 
College of Surgeons, the Catholic Hospital Association, and other relevant 
groups. • ^ ■ ■ % 

DISSEHniATION OF RESEARCH RESULTS : . 

Results arfe not yet avajlable Ai**ce t^ie study is still in the pre-data-col lection 
phase. As mentioned above^iJ^eveF^the' investigators hav« discussed the ' 
project widely ^with repreamtati veslcf relevant associations and have consulted 
with both researchers ana practj tic^rs i^ order to perfect the research plaji 
and procedures. Additionally, they have made aj^rangements to disseminate fnforro 
tipP^'ncerning the objectives ^nd methods of the research through journals and . 
newsletters of the American 'Medical Association and the /^^erlcan College of 
Emergency Physicians. , - * 

• Af^r the data are collected and .analyzed, a special "feedback", report i^ill be 
prepared for distribution to the hosfJitals participating in the stuJy. Each 
hospital will receive data abput its own emergency department as well as data * . 
about particular groupings Te.g., urban-rural, smaJJ-large) of hospital emergency 
departments. Research presentations communicating the findings of the stiidy 
will be made at professional TOetingSr seminars, and the like, both prior to 
and^aftep^ thi completion of the project. In addition, theoretical, substantive, 
acwJ methodological articles wi'll be prepared for publicatio^n in scientific and' 
profess,iorf&l journals. Jh? final report of the project wil*l be suitable for 
publication and wi<fe distribution.^ 
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ilGNIFiytCE : • . . . 

A key arfea in which there is an opportunity to improve the capability of 
EMS sys,t^s to reduce mortality and morbidity at an affordable cost is in 
the training of Emergency Medical Technicians (EMT's) and paramedics who 
provide prehospital care. Up to this time, however, the best available 
methods for studying the performance of these vital responders have not 
been reliable and have been ajxje to consider only whether or not these 
personnel ' performed particul^ tasks in appropriate situations. The 
measurement methods wece .totally inadequate to evaluate aspects of the 
speed, sequence and .qyalia^ of task performance, essential- features of 
proper initial resuscitation.. In this, study, trained observers will be 
placed on emergency vehicles to record. the ac.tivities of these emergency 
personnel. 'The findings'wilV^ovide definitive information concerning 
•the. relationships betweetLexi sting proficT^nfy and certification tests 
,and actual, performartce.- The study will also determine the best method of 
momtoring performance* in t*ie field, as well as the relative importance of 
training versus experiendfe in good performance. Selection, training arid 
employment of emergency medical technicians are significant and costly 
components of EMS systems, and more efficient methods to assign and monitor 
ambulance personnel will have important consaquencis for the budgets of 
communities nationwide. tv?n more important, the effective performance of 
the entire. Emergency Medical Services system in saving life and reducing 
disability bapns with the apprdpriate and skillful Administration of 
prehospital care by the workers in the field. Hays to improve the education 
and testing of these technicians will, translate directly into benefits to the 
victims of sudden and serious illness and injury. 

PROJECT DESCRIPTION : - ^ * ' . 

* 

Thesetting for this project, Jacksonville, Florida, is ideal. Not only 
Is the Emergency Medical Services system in this community widely considered 
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. to be a model for other metropolitan' areas, it is also an excellent site for 
systematic investigation because of its strong, central administrative 
control, deeply committed to supporting this study. About 28,000 emergency 
calls are handled each year by a two-tiered sysrtem. Initial response to 
medical ejnergencies is provided by a fire-department unit staffed by combat 
firefighters who have had basic EMT training. Because of the number and , 
the location of fire stations staffed by the* versatile personnel, average 
response time for these units is 3 T/2 minutes. Firefighters immediately^ 
administer basic life support ,irii^luding cardiopulmonary 'resuscitation fSr 
heart attack victims, and conttffue Co do so until a paramedic unit arrives 
at the scene— about 4 minutes later, on tjie average. The paramedic unit then 
assumes primary responsibility for stabilization of the victim, with the 
fire uni^roviding assistance as^ecgssary. 

Observers will be guided by careful ly-dgsigned protocols; they will ^Iso 
have extensive training both in emergency jjiedical procedures and in methods 
of systematic observation. They will collect data on about 500 calls, ^ 
, selected according to a sampling frame 'designed to focus on those incidents 
^which involve serious illness or injury. The source of these observed j 
responses will include urban and suburban JacksonviT1e» and rural areas 
in the surrounding eight counties. The data obtained from these 
careful observations will be correlated witii proficiency-test scores ^ 
and with other^ characteristics, such as level of training and degree of 
experience of the personnel. The information will als:o be compared with 
data collected through self-reporting methods,, so that recommendations 
about the most accurate and efficient approach to performance evaluation 
"Can be provided to EMS system managers. • ^ ' 

PROGRESS : 

The project has selected staff and is developing its administrative 
structure and instrumentation. ActuaV data collection is planned 
to begin early in 1978. ^ . 



./ 



DISSEMINATION OF RESEARCH RESULTS : 

In addition to presentations at scientific and profess^'onal meetings and 
journal articles, an important avenue for dissefnination of this project 
jelates to its setting. The prominence and prestige of the Jacksonville 
Emergency Medical Services system* in the eyes of EMS administrators and 
policymakers, arid the serious committment which the local EMS leadership 
has made, to this project,, instjre that the recommendations for system 
improvement which, will be -forthcoming will have direct and immediate , 
impact on other communities. ' . * . 
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SIGNIFICANCE: 



The* primary objective of this project is to design a set of procedures 
to develop, score and interpret certifying examinations for the newly- 
emerging specialty of Emergency Medicine. The^nodel resulting from 
the research is expected to be scientifically sound* and potentially > 
applicable to specialty certification in other medical areas. 

About thirty residency programs have already been instituted in the 
new field of Emergency Medicine. A specialty certifying examination 
will be administered by the American Board of Emergency Medicine 
.beginning in 1977r78. The American College of Emergency Physicians, 
representing about 10,000 physicians nationally, is enthusiastic about 
developing the best certifying examination possible, and has welcomed 
the tfvterest and assistance of a recognized medical education research 
team, the opportunity to use research-based information in developing 
a specialty exam and evaluating it empirically against physician 
performance occurs -rarely. A performance- validated test will "have 
direct benefits in improving and assuring the quality of emergency 
medical care, and will' also be useful /in terms of its future impact 
upon certification examinations fpi* othfer medical specialties. 



PROJECT DESCRIPTION ; " ; " v ^ * 

Thts study will build on new techniques of educational research to devise a 
better test method for this new medical specialty. The exarfination to 
be developed and analyzed will be comprehensive {mul tf-domain) ^ It will 
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alsol^e "triterion-neferehced"; that is, it^-wrll be^graded in these 
several dSmains Sgainst the performance of^a group of "exemplars*'-- 
Eniergency Medicine practitioners .who have* demonstrated their expertise ' 
in, the field and'^^whose test perfortnance is therefore judged to be the ^ 
standard competency 4' In order to be certified, the' candidate must' 
i\ least me^et this standard in alT domains in contrast to a norm- 
referenced grading system in which candidates' scores overall are ranked 
agaitist each other',, and- an arbftarary cutoff is. applied (i.e., "grading . 
om a 'curve") . * ^ - ' 

The research oi)jective§ .fncTude explorations ^Of wajs to select test 
items and to design scoring procetiures^for tfte speciaTV examination, 
ihcltfdjng /tests of reliability and content validity; 'comparisons of' 
criterion-referenced versus norm-referenced test strategies; tests Of 
fhe abf^ity of the ex-amiriaition to predict physician performance and, 
competencies; and analyses of the judgmental processes used in certifica- 

• tioti decisionmaking. . . ^ . . • 

Data for analysis will -te obtained* fr'Om field tests using medical students 
resicterits in approved 'Emergency Medicine training programs-, and practi- 
tioners rexroghiz'ed as experts in the field of Emergency Medicine. An 
Advisory Qroup of national ly recognized consultants will oversee arid 
document the research and- development activities. 

Among the thirteen researcl) areas to be examined are such ^problems as 
the value of multiple-choice formats versus simulatioYi formats and 
the value of "tracer diseases^" as'indicators of clinical competence. 
.Lists of the elements of -competent physician performance defined by 
logic will be compar^ with performance measures determined empirically. 
In addition, the' Research will include ^n 'investigation of the predictive 
validity of the examination "in estimating the performance of Emergency 
Medicine practitioners • ^ 

PROGRESS:- • . ' . • 

/ ' 

This projject has beaun to* examine the per'fonnance dimensions of a pijot 
certifying exam, and is establishing contractual relations with the 
American College of Emergency Physicians. .Methods to follect and 

organize empiric data are also, being developed. 

* • * » «* 

DISSEMIfjATION OF RESEARCH RESULTS > ' - ' ^ 
; — : — 7^—^ 

The results of this research will be incorporated ihto-*^ procfedural " 
model, with documentation through supporting data.' Jhe model will depict 
the development, scoring and inte^pretation•of cerltffication examinations 
with'a potential for increased predictive validity relating to measures 
bf^c'ompetence in health. care delivery settings. ' ' . 
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SIGNIFICANCE : • .. 

The -basic objective of this research is to develop a model for predicting 
the occurrence of a myocardial Hjifarctit>n (MI) . among patients presenting to 
an. emergency foom with sympjtoms coosjstent with, but not necessarily 
diagnostic of, ap MI. The model aims to improve utilization of limited 
Coronary Care Unit beds by assuring the admission to the CCU of patients' 
wjth a reasonable probability of. having an HI. , ^ . 

The research also addresses a number of secondary questions, including {he 
following; ^ . . ? . 

a. ^ What are the proportions and .determinants of false positive - 

admissions and false negatfve discharges of MI patients from 
the emergency room?- .. ' ■; 

b. What are the risk factors, historica-l cl inical , and"* electro- " 
cardTographIc parameters used in making .correct and incorrect 
CCU admittitig .decisions by the housestaff? • 

c. ^ What are, the effects of social characteristics of the patient 

and the phtsician.arid of variations in staffing' patterns in making 
correct -anti .incorrect admittfng decisions'-fay the residents? . 

•d. What is tte '.effect of an information feedtjack Toop, using a 
logistic regression model as aspuree for objective prognostic 
admission criterfa, on reducing errors in judgment by the hou^e- 

' i - . t, ■ ■ 

pis prognostic, model i^ designed to be operationally- practical and applicablf 
for ultimately sup'*''''' — — « . r. _ 



uementing physicians' diagnoses in the Emergency Room.- 



Although recent studies have questiArred the effectiveness of intensive 
cononary carein influencing* outcomes for hospitalized patients, it is still 
widely believed that CC\)^^ are beneficial. The literature suggests that 
further anali^is should be directed to patients who are most likely to derive 
the greatest .benefit from CCU care. There -is no serioi/s dtsagre©nent among 
American physicians about hospitalizing in CCU's a-ll patients ;^ith bona fide 
Jil's-in order to monitor arrhythmias and intervene early with drugs and/or 
defibrillation for potentially life-t>ireatening arrhythmias. The practical 
and critical question pertains to that .group of patients admitted to the 
ecu who do not have infarcts. A reduction in the number of these "false 
positive" aHmTssions represents one method for ^reducing the overall cost$ of 
this very expensive care unit^ Ten years of rapidly rising costydue to 
proliferation of CCU beds, inflation, and m^clical -manpower limitations have 
engendered a rethinking of the* essential cost/effectiveness ratio of these 
specialized units. The cost^data are well known: CCU beds are .at least 25% 
more expensive than routine, hospital beds, CCU per diem costs have risen 
by more than- lOOX in the* past five years/'and serious shortages of nitrsing 
staff exist. ; ^ . 

Thus the practical and critical focus, in the cost/effectiveness question 
is related to that proportion of patjents admitted to the CCU who do not 
teve Mis. j| * ' \ 

PROJECT' DESCRIPTION : '.^ 

A multiple-discriminant logistic regressi.ftn model for predicting the 
occurrence of an HI in the context of patient admissions and discharges from 
ao emergency rooqi is being develo'isied. The mod$l is based on empirical observa- 
tions of 174 variables available in the enjefgency room (ER), including 
patients' risk factors, presenting -historical ajuJ clinical parameters, initial 
ECGs, symptcxnatology, and social'and organizational' factors. The 174 variables 
are reduced by cluster analysis into mutually exclusive and clinically logical 
clusters which will be correlated with the final diagnosis of HI and with 
false posYtive 'admissions, and false negative discharges. Frc^ these correl^- 

. tions, equations predicting each of these outcomes will be developefd. Lastly, 
over a period of a year, ^during alternate months, the predictive results'^of " 

.these equations will be available- to the admitting ER physicians on a patient- 
by-patient basis. The^utility of such predictive equations a^s a suppl^ent 
to the clinical decision-making proems in the ER will be examined as to their 
effect on increasing appropriate actalssions and reducing false-positive 
Admissions and falsernegative discharges. This model -can easily be extrapolated 
to adetssion -decisions regarding a large array of otlier tommon medical probl^s 
seea in emergency rooms. ^ ^ 

The study is being conducted at the ^ostonCity Hospital, wbich is located tn 
Roxbury, Massachusetts and serves an inner-city population. 
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Any patient who presents to tbe'ER v/ith one or mofi of the "Rotterdam "WfR" , 7 
syrtptoms^ and si^ns an Informefl consent form, is. eligible to paj!>ticfpaie i*i 
the study. This list of IMIR symptoms is. derived from ^he'Netherland^s IMIR 
(Ihnnnent HI-Rotterdam) Study, ^and the sympt-oms are as follo-^: 

recent chest pain recent unexp^4<Tied 'syncope 

receot unstable angina pectoris recent unexprl a ined tiredness 

, recent unexplained dyspnea * recent unexpTained irritability 

recent unexfJlairved palpitations. rece/it unisxplained fear or tenseness 

recent unexplained upper abdominal^ pains o^ther reasons 

All eligible study patients are identified. by the triaae pers'onnel* irr the ER, 
and then the research assistant interviews the patientr drafws bloods for cardiac 
enz^s, $nd taket.dn ECG. \ . . . - - . 

Pat-lants who are actnitted to the hospital' are fblTowed during hospitalization, 
,at which time ECG» amd.cardtac enzymes ar6 collected, and a questionnaire 
given. Patients wtfc are eligible for the study, but who are discharged frwi'the 
ER5 are scheduled for a foll6v-sp appointireot within 72 hours,' at which tine a 
second .interview, ECG, -and set of enzymes are obtained. Based on this follow- 
'up information, patients Judged by the ER admitting resident? to be in need of 
, immediate. medical care are admitted forthwith'. 

Performance of .the triage personnel is n^nitored routinely by 'a daily 
review of all ER charts^ 

PROGRESS :' ' • * • . / ' • 

Data collection was begurr prospectively on Septeinber 1, 1976. Froni that 
date until January 15, 1977, 421 patients presented to the ER with one of the 
IHIR symptoms. _0f thesej 161 were discharged and. 260 were admitted as ' 
inpatients. Follow-up is successfully completed for 92% 'of the a<taitted and 
the discharged patients. InitiaV analysis of the data indicated that there 
were mny variables capable o? discriminating 1n varying degrees of precision 
"between true posftives and false positive. patients, suggesting that a series 
of weights is necessary in such a predictive rrodel-. 

To be of greatest use, any rriodel anployed in an ER must be capable of 
synthesizing and reducing massive amounts of input data i^to a small series 
'Of predictors which will /ield discrete probability sta-tements.; To arrive 
at these -predictors', the investigators exanJined the relative diagnostic value 
of 174 Variabl-es available in the ER in all combiaatioiis for a.n patients with 
»ne" orinofe' of the IHIR criteria. FKty-nine of the 174 variables occurred 
with greater than ?0% frequency in the ischemic heart disease and non- 
ischemic heart disease patients. The 59 variables were reduced by cluster 
analysis Into 22 mutually efxclustve and clinically logical dusters. A step- 
wise discriminant function identified, nine of these cluster^ as adding 
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significant predictive power to the diagnostic modeh The contribution by 
cluster was; ' ( . ^ . . 



ECG^ • (.179) . ^ 

^ Past History HI (.097) • - 

Chest Pain {;045) 

. Transportation (•01.7) , ' ' , • 

Demographics '{•010) ' 

Palpitations (.006) 

Day of Week { .1004) 
Congestive iHeart' 

Failure t - (.004) . . - . 

Symptom f reqiiency { . 004 ) - 

In comparing the diagnostic classifications predicted by the restilting model 
with the. accuracy of housestaff physicians' ER' 'diagnoses , it was found- ihat 
the model was cap?tble oT correctly reclassifjfing 84% of patients into correct • 
^ ^diagnostic categories. The physicians classified 81% of the patients correctly 
The 4ata suggest that the model, in conjunction with the physician's diagnosis, 
can diagnose ischemic heart disease correctly in 94% of patients. 

In year 2, this model will be applied prospectively, both independently and in 
cenjuRCtioit with house officers^ diagnoses. During six ranjiomly chosen months, 
the mo3eVs prediction of .the probability of an HI will be compared retro- 
spectively to diagnoses reached by ER physicians. During the other six months, 
thp model's prediction of the probability of HI will be calculated and given 
to the Junior'Resident making the diagnosis*. The Resident is^ expected to 
take Into account this probability U\ reaching an admission/discharge 
decis1t>n, but is free to ignore this additional information. This control led * 
trial will be essential to. transform- the model into a practical clinical 
tool and to delijieate i^s areas of potential effectiveness. ' - 

The final model wi]l permit. the synthesis and quantification of 'large amounts 
of input data which affect admission/discharge decisions, of patients with 
suspected myocardial infarctions, Potent+aHy, ttrrs irodel iranr^lirreate'-the--^^ 
.relative contribution of ^multiple sets of factors in the decisi^ making 
process, including the' inappropriate influence of social factors and staffing 
pattems. I-n addition, the model -will be able to be utilized in an educa- 
tienal program for housestaff. ^ ' ^ * 

In siffiinafy, this mod$l has three potential areas of significance. First, the 
model can be useful in insuring' appropriate utilization of CCU beds. At 
today's CCU inpatient cost, even a small percentage reduction of false positive 
A* admissions can result in large savings countrywide. In turn^ reduction of . 

false negative discharges might lower t|ie out-of-hospital case fatality rate, 
|. in that two-thirds of this latter group'of patients have been seen by a 
physician a» short time before .their terminal event. Second, the model can be 
useful as ^ teaching tool-for housestaff, especially. in. delineating the 
influence. of social /organizational factors on these decisions. Thirdly, the 
uodel can be expanded to include many of the. other einergent clinical problens 
seen in medTcal anergency rwrns. Such a model lends itself as an adjunctive 
predictive topi which can easily be incorporated into the clinical decision 
making process in that environ J a 
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DISSEMINATION OF RESEARCH RESULTS 



Presentatiorys 

■'..»■ 

H. Pozen, R. D'Agostino, J. Gugl ielminb, tl Teebagy, L. Bielawski, W. Hood, Or. 
Relative Effectiveness of a Multiple Discrimipant Model Versus Emergency Ropn 
Physidians in Oia.gnosing Acut»HyocarBial Ischenia. -Paper to {>e presented to- 
thp American Federation- for Cl-inical Research, Kay 2, 1977, l^ashi/igton, D.'c-. 

Ajneri^an Statistical Association and the Biometric Society, April 30, 1977- . 
Comparisons of Predictors Made by Logistic Versus Oiscrininant Hode.ls for 
Diagnosis of Hyoca^rdial Ischemia. 

/taerlcan Heart Association, May 20, 1977 - Presentation of Logistic Eegression 
Kodel for Predicting" Acute Ischemic Heart Disease - A Retrospective Analysis 
Based (To .750 Patients . * • ' / • •• • . 

Pyblicatiens' ' - - ' 

Relative Effectiveness o'f a Multiple Discriminant Model Versus Emergency Roocn 
Physician? in Oiagnosif\g Acute Myocardial Isch^ia - A 'paper prepared by 
Dr. Pozeh'and Or. D'Agostino, which will' be presented at the Nationa) 
Meeting of the American Federation for Clinical Research and then formalized 
for publication. 

A second article with Dr. D'Agostino as the priRCipal author will focus on 
.the statistical aspects of this analysi-s', and will be sutxnitted to a biomedical/ 
statistical journal . • ' _ ' ■ 

An Analysis of the Rose Questionnaire - An Emergency Rootn Update. This" article 
will focus on some of the fairly significant disparities between our findings 
concerning the use of the Rose Questionnaire and th& or'fginal Rose Question-* 
naire as published .in the Bulletin of -the World Health Organization (27:545-^8. 
1 962]^^ ' 



Assuming that' one or- more of the abstracts listed above will be accepted, in 
a like manner, papers will be presented and submitted for formal publication 
soon after the meetings in which they are given. 



J: 



102 



r 



IC- 



TITLE : Outcode Measure of a Suburban •. gfeANT fnJHB£R ; ] R18 HS 02456 

Paran^dic Program . , . • 

GRAfjTEE INSTITUTION : King County He?Uh Department , " " 

PRUiCIPAL' IWESTIGATOR : * FURDIfiG LEVEL : $89,555. 77 

; ' ' .. ' SS8,592 FY 76 

Lawrence^ Bergner, H.D. , • . • ■ ^ 

Director^ , 

Seattle-Kin^ Cpunty DefJartnent . ' . ' 

of, Public Health ' TOTAL PROJECT PERIOD f 6/30/76- 

1500. Public Safety Building • . 3/31/79 

Seattle, Washington 98104 
(206) 625-2154 



SIGNIFICAIJCE 



A proliferation of eriergency rrJdical services has occarred riatiorally .during 
the past five years^ The heightened interest arrd CQilcern for ST»^gency 
services has beeo manifested by the training of thousands of Emergency 
Kedical Technicians (EKT-A's) and paramedics (D<T-?'s), the establ ishr^ent of 
local Emergency Kedical Services Coordinating Councils,, and draratic populari- 
zations in the media • - ^ * 

The professional and public interest in e^^ergency rrfedical services has been 
accompanied by a need for evaTuation of these programs. The Dnergency Kedical 
Services Systems Act of 1973 requires evaluatio/), 9f Feder,all^ funded prograins. 
In addition to thi's mandated requirement, there fs a general denand for 
accountability of the programs. 

The goal of most emergency medical syst^s is straightforward: to reduce 
mortality and morbidity restjlting frD:a necfcical emergencies. Evaluation should 
,be designed to meajure this effect. Most evaluations to date consider the 

stud-ies evaluating outcooie results. • . * 

This study is tl?e first nationally to evaluate critically the outcome of 
paraine<^ie'ssrrtce In a suburban community.. The results jof this study will 
define for other suburban coitminities the . benefits of such a program for • 
treating cardiac arrest.. ' 

Of natioha^significahce is the fact that the study will allow definitive 
comparisons ^s .to the cost of paramedic services and the effectiveness of 
such programs, •specifically how many lives can be saved at what economic, 
cost* 'The costs of training and equipping paramedic teams are corisideraBly 
greater than for BIT units, and it* is tre!>ejidoi«ly important to establish 
that these additionaUcbsts are v^rranted* in terns of improv^nts . in 
morbidity and mortality. Such cost-effectiveness analysis will have considerable 
iinpact on national policy fonmilation. 
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^Oh a local level, the KingXourvty Council has expressed' interest in the - 
study and has stated that the findings \*in play a. significant, r9le in future 
allocations of resources for paramedic programs. This project denK>nstrates 
that*outcon)e studies are fea'^ible andiuseful for evalucftiirrg existing paramedic 
programs throughout tfie nation. - 

toECT DESCRIPTION : . ' . ' ' 

• * 

The aim of this study is to determine whether the addition of a highly'' 
sophisticated and relatively expensive paramedic progVar? in a suburban canrjnity 
can improve the outcc^ of cardiac ^ergencies rrore effectively than the basi,c * 
fire department EHT program presently available in the study area. 

A before and after study design with two control coTTTfUnitnes is being ys^ed. 
The study will prospectively assess the outcome' (death, adiriission to a hospttal, 
discharge fro:n a hospital, and survival six nonths after discharge} of cardiae. 
e^sergencfes which occur during 15 months in- the study comnunity*( populate on 
320,000) presently served by EKTs-, a parar^io control cornriunity (ooPulaticn 
220^000) and a non-paramldic (EKT) control cormjnity (population 100, OOC.. 
The study .coonrrunity will then have paramedic services added and another '5- 
month prospective assessheot of outco-^ wi.ll be nade in all three area-s. 

Data are cpllected on all sudden cardiac emergencies which occur ih trie study 
and control comn^nities and i^hich meet the^case definition. A case is dfefined 
as a patient who receives cardiopulnonary resuscitation (CPR), follo^*^ing . 
circulatory arrest in a non-trai^ situation CK:currin^ outside hospitals. A 
s^jrveil lance system .has been established with the cooperation of public and . 
private agencies: All ^participating agencies (fire departments and districts, 
aiAulanCe companies, hospitals, and police departments) notify the research 
office of each CPR event within" 24' hours of the event/ If hospital admission 
occurs; the hospital is contacted for follow-up information. 

In order to assure ]00% reporting of all CPR incidents, redundant collection 
systems-are maintaif^ed. 'One systen involves review of Medical Inciden^t Report 
forms sent to the Emergency Kedical Services Division of King County by 75? of 

hospital emergency roon logs. These logs include name, date and ^ergency 
agency for patients arriving in the ei^rgency roons who have received CPR. In 
addition to the infonsation requested on a questionnaire, the study obtains - 
infoffeation froa the King County Medical Examiner*s Office.* Tniscause of death 
as listed on the De^th Certificate isr also obtained* * " \ 

Oif the basis of the ''questionnaire, hospital record roan information, infornia-. 
tfon from the attending physiciaa, autopsy reports and death certificates, 
ca'ses are classified into etiologic categories: cardiac, respiratory, suicide/ 
overdose, etc. Cardiac incidents are further classified by type of cardiac 
rhythm^ * 

The final outcome measure is survival at six nK)nths fol towing admission *to the 
hospital. To determine the functional status* of patieats, each patient*' is 
interviewed using the Sickness Impact Profile (SIP). .This is a 136-question 
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health status measurement too] designed to determine the physical and the social/ 
efootional health status of the patients. In addition, all patients are asked 
a small Series of questions developed, specifical ly for this study. This latter 
group of jqiiesti6ns incltides descriptive information comparing current eriployment 
and the ability to care for self with 'the situation prior to their cardiac 
|rrest. ^so, informatipn an hospital admissions during the intervening six 
months anabyier pertinent information is collected.- ' 

PROGRESS ; . ' ' * . 

The re;5ults, ry)orted here encompass only nine months of the prQjected SO-nonth 
study period. The vast majority (83%) of the 304 incidents which occurred 
.from April through December of 1976 were cardiac' with a relatively smalj per- 
t:entage representing respiratory, suicide/overdose, drowning and other. Of 
the 304 cases, 75? died before hospital adrrission and 25% were admitted. A 
total of 14% survived to he discharged *f rem the hospital. In the paramedic 
area, 37% of the patients were admitted as cc^pared with 185^ in those areas » 
served by EJTT's/alone. The differences are not only statistically significant 
But large, showing \hat the paranedic areas have the Highest adrission and 
discharge- rates, approximately twice as high as the other areas. 

Host of the patients {72%) are maTe. The average age of all patients is 58 
years.. Admitted patients averaged 56 years of age apd discharged patients 
averaged 53 years.' 

Some validity is given to the tise of response-'time as an D-5S system perforra^ce 
measure by the findjng that if CPR is initiated within less than four minutes\^ 
after collapse, there is a higher likelihood of admission (45%) and discharge 
(16%) than if CPR is delayed by four or more minutes. When CPR is delayed by 
four er more sinutesu, 34%, ar$ admitted and only 6% are discharged. Given that 
CPR is begun early, howevecs it^y be that the length of . time it must be 
maintained before more definitlf/e steps are taken to stabilize the patient 
becomes acritical* determinant Vf survival. Paramedics can perform cardiac 
defibrillation and other procedures which must'othen</ise await transport to 
the J}Osjgn ta^K^ 



At tfjis point the long-term outcaiie, survival at six months, is not reported 
because the study has not proceeded far enough to make TOanihgful conclusions.. 

rAlthough only preliminary .fin^jngs on the first nine months of the study are 
reported, it is apparent that an,, outcofr^e study utilizing a before- and- after 
design-with control communities is feasible."^ It is anticipated that the \ 

•findinqs at the conclusion of the study will allow definitive statements as to 
the value of a paramedic program in reducing cardiac mortality in a suburban * 
setting'. / 

# 

DISSEHIMTIOH OF RESEARCH RESULTS : ^ 

1. Abstract presented to the Nationial Em^gency HedidaT Services Evaluaction- 
Syraposium, New Orleans, January* 10-11 , 197?. 

' t 4 
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2. Abstract accepted for*j?resentati6n to the American Public Health 

Association. Annual Meeting, .Wa«hington, D.C., October 30- November 3, 
1977.. ' . • . „ 

3/ Abstract submitted for presentation to the Robert Wood Johnson Clinical ' 
Scholars Program Annual Meeting, Lincolnshire^- 111 inois, October 26-30, 
1977. , . , . / 

Several -papers are in preparation/ Because of its potential natiorial 
.significance, requests for i'nfonnat.i on," about the project have been 
redeived from numerous emergency medical programs throughout the nation'/ 
-i^any requests- for iliformation are received from elected officials,' press, 
and emergency agencies in the Seattle area also. 
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SIGNIFICANCE : / ' ' ' , ^ 

♦ * * 

The significance of assuring the/quality of care provided by the ^ergenty ' 
medical services (EHS) system cannot.be overstated* The emergency medical - 
team is usually the firs-t to provi.de care to the patient in life-threatening 
situations.* In the case of acute illness or injury, the patient turns to 
snergBncy medi-cal services for carfe' that is not immediately accessible else- 
where. Even in -situations of less acute illness or injury, the public utilizes 
emergency departments to seek primary, rion-ertergent medical care - f)articu>drly 

.when 'a private physician is unavailable- to them (due 'to reasons of 'time, money, 
or knowledge). Thus, the EMS system addresses a wide variety of emergent and^ 
non-emergent situations that caM for immediate action. Often action (nust be^ . 
taken under extreme pressures. of limited time, inadequate information, about the 
patient, and incomplete information about the patient's illness* The quality* , 
of medrcal care' delivered at this initial contact with the health care delivery 
system. can directly, and often seriously, xiffect the subsequent course and 
deration the -patiemt's i*llness* The social, psychological, and economic costs 
of illness and disability can be greatly reduced when the highest possible . • 

"quality of emergency medical care is assured.. The potential of decreasing human 
suffering -and the costs of this suffering to society are well worth the efforts 
Currently being expended. 

/. ^ » ' ' ' . . " ' ' 

PROJECT DESCRIPTION: ' ' - ' ' - * > 

* ' * * ■* ♦ * 

Qua^lity assur^ince implies the use of the vprlnciples of, evaluation to assess * 
the quality of current care ancj improve future care* Assessing quality in 
emergency medicine involves selection jOf the appropriate iUnesS or injury types 
to *bfe' studied, determininj the type and source of data, to collect, deftnin^^ 
CrKeria against which actual care can be measured, 'devel oping" methods 7or 
scoring and sumtnarizing the results and developing methods .for using these 
results -to improve the quality of care through' feedback and education'. *A total 
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' system of quality ^tssurance shquld incl-ude all stag&s of the EMS system: pre- 
•hospital, emergency -department, in-hospit?l, and, ultimately, outp'atient follow- 
up andi'rehabilitation. The complexities .of such: an evaluation system require 
development of a prototype, ,01: modeU'tha-t can then be tested, refined, 
implemented and expanded. . ' ■ • 

t , , • ■ • ' . ■ , ' ^ ' * 

The purpose of ,thii .research Is -to design- and 'test a model for a Quality 
/of^no"*^^ System that can be used in emergency departments of large hospitals ' 
(25,000 or mere patient visits per year). The focus is on the -steps in thfe' 
emergency niedical care process and, their effects on the patient. The scope 
IS to design: 1) methods for selectin'g the appropriate illness and injury 
types for evaluation; 2) criteria for evaluation measures; 'and, 3) basic data' 
col-lection tools for evaluation. ^. " ' ^ ' • . ■ 

The Research Laboratory , ' - ^ ^- •■ 

The laboratory for t+i'is research is. the" clinical division of the Department 
^f Emergency Medicine-, Los Angelgs County-University of Southern California 
-Medical Center. With nearly .5,000 patient visits per week, this environment 

provides an appropriate setting fo> gaining infonrtation on the. emergency • ' 
.medical care process and for initial .trials of data collection tooU. 

Selection of Illness/Injury Types . - ■ . 

Emergency medicine is a specialty/with unique problems of diagnosis and 
, treatment. The presenting, symptom' complex and medical history of the patient 
are often .unknown or incomplete. yTreatment, of tKe patient often requires a • 
rapid response by the ^emergency^edicgl team in order to st'ablize and/or 
supports life-. At the very le^t, the emergency- medical team must provide * 
tempofary comfoVt, relie'fXr interim. care to the" patient until more extensive 
diagnostic testing and definitive treatment can t)e undertaken.* Given this 
unique circufnstance, selection of the illness and iVijury 'types for study cannot' 
be based solely on specific diagnoses. The approach has been to develop a 
Wking list of Illr^ss/Injury types thai includes presehting symptoms as weVl 
as diagnoses A* / ' ' ^ j ^ 



A systematic approach is used,toaxleatt€j4.iheaWoasWin;j*ir^. types to-be 
se+ected for Indepth evaluation. The selection me,thods I^hould' be adaptable to 
the needs of individual emergency departments, and-shoyld consider the complexity 
qf recognizing and treating, ea'ts^ clinicaJ problem as well as its- frequency in '- 
the dqpa^tment. - The procedure xlesigned for selecting the -study Ttypps includes: 
1) -periodic survey of the pati6nt population and chaiiges in problem character- 
istics;; 2) ratinq of the IlJness/Injury types; 3) analytic ce^ew for special 
problems; and, 4) finpl selection. Each emergency dfepartinent may have unkme 
medical factors or practical problems that influence the choice of lUness/ 
Injifry types for evaluation. The value of a systematic ^proach to these 
chfflces 1s to accomodate any suth special problems'. ^ 
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• " Development of CriteHd for Evaluation of Care ^ . s ^ , : \ 

^ In order ^to develop a quality assurance -systent model , criteria describing 

appropriate emergency medical care need' to be define,*/ Evaluation implies some 
- v-: degree of judgipeYit and sub^'ecti^ity. To the extent that ftie basis of thes^ • ^• 
judgments can be defined, expl icitly and ordered in advance, eva-luation ^fforts * 

• *will become more objective:. Evaluation.xCriteria are needed tojd^ine ,sQme 
• / minimum level of appropriate emergency' medical care. Such cjj/tKK 

' ' s^cific enough- to allow measurement, but flexibl^e €nougK ^^^KK^^^ 

circumstance anfl unique department^organization. Indi^Jidira^yze^tandards for 
each case seen in an eipergency 'department woul^ be impractical, b'ut'general , 
patterns ol: treatment for specific categories of jllnes?scan be ^developed. 

, The criteria. for quality emergency medica l carej^ aa best be defined by 
prO;fessional .medical [ieer consensus. A vi^^nr'^^QXiT^'^y ew committee was 
/ - formetj to develop res§arch' "heuristics'' (rrtT ,.,generarTwtterrts df treatment 
for specific Illness/Injury types). Once such general patterns are. defined, 
the medical steps can be refined into a flow-rchart format (algorithm) that 
* ijlenti/ies the maj.or decision and management points in emergency medical care. 

^^"^ Development of Data Collection Tools - "* ^ "^'^ 

. ' The focus'of this model of quality assurance is ev^aluation of the actual car^ 

and-treatment process. This requires data on the events that actually occur. ' 
'\ Data collection tools have bei&n develjopfed and are^being continuously refined. 

These have included: 1) observation of patient management by trained observers; 

2) analysis of patffent ma-nagement records; 3) telephone interviews of pc^tients 
' retgarding their conditions; an^, 4) a filot study of^^patient attitude^ toward 

the care receive^. - ' 

. Observation techniques were used as a primary data source, since entries in 
the medical record cannot be qtiliied,as the sole source of information on 
treatment events. Medical .records usually contain only a portion of information " 
obtaihed about tfie patient and the c^re .delivered to the patient. Observatibn 
> yields additional information regarding what is done« what members ^f the staff 
^ are involved, the order in which items are dope, and the tim^ taken to p^form 

* these services. * ^ 

€arly observation studies did ngt yield enough det^ regarding the medical ^ 
history>ai^ physical ex^aminatlon, .and .therefore, 'Observatiorv tecHijiqu6s' are 
.being refined. Medical histdry and physical examination forms are being tested 
bywresearch personnel as possible additions, to the current limited fon^s used 
fo\the medical record^. A basic problem of' quality' assurance is to capture* 
detlMled infoaiation iDn the history and -physical . The emergency medical team, 
more. often tr^ not, performs procedures and obtains relevant information^ about ^ 
the patient, but simply does not have time to Vecorij it.\ This problem will 
not be easily resolved witKout providing technical support to the clinical ^ 
staff in the form of computers^, human scribes" or other personnel assigned the ^ 
' task of medical documentation^ - ' 
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Progress- to date'on the project can be briefly sumnarized as follows: 

Illness/-In.iurv Types. Fif4:y-six Illness/Injury types have been 
Identified- through surveys of patient populations and' emergency ' • 
. physician task analysi-s. A tri'al physician rating system of these 
■ . nine^s/Injury types has been attempted. -• 

' 2. Critefia for Quality ; 

■ • Research H euri'stfcs . Fifty-six preliminary research heuristics 

^whlch defin^^the basic ingredients of emergency medical care 
"for each ^lln^ss/Injury type have been dej/eloped and reHn^d 
j^, -by research peer review through case review and analysis- 

procedures. ■ . , 

^ b. y search Algorithms . Twelve of the above Illnes3/Injury types 

have beeh developed into reseaKh algorithms (flow-charts) -' 
'tf* ^'nich .define the major process steps in emergency medical care, 
the procedures to b6 performed and the 6rder of performance. 

3. Data Collection To ols. - ' • . 

Process Observation. Systematic observatiojf of the treatment ^ 
•process has. been developed, and refined to acquire more detailed 
inf^jntiatipn on the content of .the -medi'cal history, and physicaf 
examination. Trained data collectors aV-e currently pilot testing 
medical history and physical examination 'forms. The feasibility 
• of using such forms in lieu of the standard method of recording 
information is being assessed. • ' 

' ' ' b- Wcome Measures. A singular problem of quality assurance -is 
the need for valid outcome measures appropriate to emergency 
medicine. Problems of developing valid outcome measures are 
• compounded by difficulties in contacting patients for fdllow- 
"P 3nd medical care they receive elsewH'fere. Simple outcome 
measures that are 'clinically meaningful and useful, to <^tiality 
assQra'nce ^re unavailable. Considerable -work on this important ' 
parameter t)f quality is still required.' 
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. * • • . -\ — ■ ■ . 

DISSEMINATION' OF RESEARCH RESULTS : \ 

PCiblications. . ' ^ ^ . ■ ' . 

G. v". Anderson, A. Roy,-6. L; Looney, and P. M. CTonnelly: A Unique Approach • 
to Evaluation of Emerge'ncy Care^t_JACEP, June 1977. \ ' 

G. L. Looney, G. V. Anderson, A. Roy, R. Sctiarf; and P; H. .Donnelly: -Algorit-hms 
' in Emergency Medicine; Accepted for presentation at 'the Annual .Scientific 
Assembly of the California Chapter of American Co.llege of Emergency Physicians. 
San Francisco, June 8-12, 1977 (In- preparation for publication.) 
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SIGNIFICAN6E ; " ' , . * ' 

. ■ : • • . ' * 

Injury as a disease comprises a wide spectrum, from the very minor to the 
instantaneously lethal Sinde .traiana is the major cause of death up to the 
age of 37 years and is -asjrajor cc^t factor in delivering emergency health 
care, the treatment of injury B^'^fen ^rutiiiized. and certain deficiencies 
identified. Before objective Valuation of the quality of care being provided 
to the injured can ocpiir, and before companions can be made and improvements 
Identifiet*', some method to describe the extent of Injury accurately must be 
developed. ' . ,' . ^ 

T-he question being asked in this research is., carr 'the severity of a patient's 
.injury be described 1p quantitative terms* as a function of various jinatomical 
and pathophysiological states afitfdoes this 'quantity' accurately correlate with 
Qutcottie? - ^ " \ 

Previous attempts to develop a ^tem for scoring injury severity have relied t 
heavily on arbitrary assi^ment. of scores to specific. anatomical injuries or 
phytiploglcal states, without any proven correlation to severity or outcome, 

iAttempts to evaluate systenv performance or compare different methods to 
allocate resources which ^ely on such arbitrary measures, are likely to provide 

:in1slea'dlRg iijfonnat^on for syst^ planners afif policy makers.- , 

. Project description :/" > ' \ 

' ° . / ' 

This research project builds Upon and refines earner efforts directed towards 
establishing a numerlQal. index of severity of injury which directly correlates 
With patient status and outcome. Firmly based on a concept of the pathophysiology 
of Injuryj; the -research project alms at testing and refining three different 
Indices Which independently , and collectively are predittive of patient -status. 
The Indices are Blunt Atatofiiical Index (BAI), Acute Trauma Index (ATI) and 
Triage Index (TI). -Each indeJc was formulated from patient da4^ customarily" 
obtained to- assess ancf treat trauma victi.ms-.,. Pattern recognition and systems 
anamis techniques are' used to formulate each Index on the basis of probability 
'ofrj^tcoine.' ^ ; . • ^ ' ^ ^ ' ^ 

■ h ' '■ ' . ' . yon 
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The' indices are defined as follow;&'. BAI is the probability of patient survival 
based upon site of anatomical injury; ATI is a calculated score derived from 
measures of the biochemical and pathophysiological response t6 trauma; and TI 
is thfe -score re-lat^d to probability of patient status based upon ten physiological 
parameters. which are obtained to assess clinical status in the prehospital 
phase or immedia-tely on entry- to a hospital. 



PROGRESS: 



Durfiij the first year o'f this research effort,' operational defini^tions for the . 
data elements in the Triage' I nde>f>-.were devised, tested/ revised aftd then 
accef^ted fcv* implementation. The data coj Section forms for the ATI and BAI were 
devised and' tested. Subsequent modification lead to combining the two forms. 
Protocols for .identification of the patient stJdy population were develofped and 
explained to all personnel. Fal^e exclusions are' analyzed by individua} time 
and shift and special meetings held to correct deficiencies in data collection. 

The problems in improving interrater reliability for the data collection 
personnel prompted several changes froro the originally proposed methodology. 
- The lack of adequate opportunity to test raters on patients >ith abnormal ' . 
sifns in the emergency department required that personnel be tested in the 
Tirtensive care units. Mechanical testing devices have arso been used where 
appropriate to validate the standard rater and .all data collection nurses. 
Finally, tolerance ranges were established for all data items to reflect 
acceptable levels of disagreements between the Standard and the raters. 

The. original Acute Trauma Index being; tested pr^ented problems in the ^ergency 
department because of inconsistent application. .As a result a new ATI was 
developed using variables which ajja readily available. This new ATI is now in 
the testing stages. A Surgical- Shock Resuscitation Team was formed in . 
February, 1977, to respond to. the needs of acute critical patients presenting 
to the emergency department. Incorporated into the team protocols are the 
desirable and clinically warranted measurements of the param^ters-^the original 
ATI, thus permitting validation of it. Continued modification of tfte^I to . 
improve its 6ase of 'use and prognostic ability is being pursued.. 

The project relies .heavily upon^he accuracy of the data collected by a number 
of people. , A strong xemphas is on continued eudcation has helped to minimize 
.the potential impact of these probljems. > . • ; 

As of February, 1977, 568 patients had been included in the study population. 
Testing and validation *of the' Triage Index on 38V patients, ghowed a 98% 
coVrelatiJon with- the otrtcwne of dgath. 'iiowever, the, limited nimlJer of deaths / 
(21) indicated that-at least 1,000 patients -will be required to test the index 
adequately. Testing of the Blunt Anatomical Index to prddict individual out- 
come and expected deaths for the population under study was carried ojut on 
271. retrospective and prospective pat4ents. The "index predicted ten deaths , 
and there were actually seven. . v . _ . 

."■ . . . J- 

ilso 



The V2rt1dity of the new ATI Is still being tested, 
to Validate the original ATi. . , 



Data are also, being collected 
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As a result of* the research, a new coding system for penetratifig.in-juries is 
^ being deve oped and will be submitted for inclusion in the 1978 revised Inter 
national Classification of Diseases. 

DISSEHINATIOh^F RESEARCH RESULTS ; ■ , , ^ 

I 

• rlJ^' ^Wion, Wu.J. Sacco, S. Hannan,- "Quantification of Human Injury" 
Ertergency HedicaJ Services Bicentennial Symposiisn, Baltimore, Maryland. 

" 'cAL!!^c"^"' ^' Champion, H. J. Sacco, "An Objective Triage Index" ACEP/ 
- EDNA Symposiun, New Orleans, October, 1976. 

H. R: Champion, H. J. Sacco, "Quantification of Injury" Proceedings IEEE. 
November, 1976» , * v j ictt., 

/ 

^ H. R. Champion, "Evaluation of Critical'Care Uni^s. Facilities Evaluation.- 
■JantM^r ^9J^«?^"ts" Emergency Medical Syst^s |ympDsium, New Orleans, 

<^fampion, "-Prophylaxis and Prognosis- in the CritiFally Injured" 
Znd Annual Symposium, Ontario Regional trataik Pro^?&m, Toronto, 1977. 

H. J. Sacco, "Evaluation of Injury"- Ffegionaf Emergency Kedical Service 
Symposnsn, Baltimore, Maryland, 1977. \ 
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SIGNIFICANCE ; • ' . • ^ 

^^^^^^^ • * 

There are approximately 54 million persons in this country who are classified 
as living In ru ral ar^s. A,,nirAl_jrg3_iAAefiJied^__fox national census 
purposes, a^ ary^ incorporated or unincorporated area having a population of 
less than 2,5067persons.' This study will focus on those areas with under 
liOOO in population. Us-ing a conservative estimate derived from census 
information, one can expect to find 10,910 places across the nation with 
populations of less than 1,000 persons. 

It has been stated that rur$l residents have emergencies .that". . .potentially 
or actually are more serious than those of urban residents." {Waller, 1969) 
Part of this suggestion is In consideration of farm work, which is one of 
thg most dangerous occupations in the U.S., following only coijstruction and 
mining with respect to the number of injuries sustained by workers. Addi-' 
tionally, the high proportion of.elderly 4n rural ^reas contributes to. the 
seriousness of medical emergencies, . . ' . • 

>fee\ing'the anergericy medital needs of this population is confounded by 

estimates that rural areas have about one-half the access to medical resources 

as compared to the rest of the- nation. Other factors related to problems of, 

^.-dealing with rural emergencies include: * " . . . \ 

% f ' , 

/I) Lack of physicians, ambulance services, or. other medical 

resources .in the iinnedlate area. / ^— ^ . > . 



Ambulance personnel are"o^ten volunteers and are not always 
readily pliable, 

{zy Distances to advanced medical resources which are often ^reat. 



Justin. A. Hyrick, Ph;D. 



(4) An insufficient-number of cases to justify and/or support readily 
available .EMS resources. \ 

(5) The w^e separation of residences; awareness of nsed for medical 
aid and calls. for assistance may be prol-onged. ^ •' 

^ (6) A high proportion of non-resfdents, many not knowing how to 
access the medical assistance system. ^ ~ 

.The pFGfalem of response time, a critical factor i|. reducing morbidity and 
mortality, of .patients who are severely ill or . injured, is particularly 
?J! IfUl u^i ^^^^ with in rural cocnnunities. -Response time," defined as 
2^4«f u5^^^^" ""^^^^ ®^ ^ '^^^^ ^^'•^ice and the arrival of appropriate 
^IfL^Zr'Ji u an emergency , does. not reflect- the total ' 

ftllL^l ?u ^{ i "^^'^ °^ "««^^"1 attention.' An important" delay 

Itl^^' ] . t3'ne,J>etween recognition of the emergency and the time the 
fSiJ?''!*?^ f?^*^^. ^'ff "'^f is contacted. Further, a central dispatch §ystem 
ifi . ^V^-^ m identifying the proper resource, obtaining the correct 
telephone number, and making contact.with that resource,, usually is not • 
infll ll,^ "^^^^ cooTO^ies, especially the low-population ones like those 
in «ie study group. . «hat*5 more, many rural communities do not even have 
-^^w^h^f S?^^^*^ resources. Thts is especially tru^Jn unincorporated • 
Iwf^i^ J? ^'^^ °^ f^^^^y resources. Inlnany cages esfen the nearest ' 
T^lV^J^l ^^^^ patrolman is many minutes ayay. %^,-this study seeks to'" 

4 f ^ evaluate an innovative approach to imfcoved emergency medical 
SJf.l! ^li^'.a'^as by reducing response time and fostering more timely and 
effectivejelivery of that care. ... 

PROJECT DESCRIPTION : 

IJpfnii^If n>^J^°^'Jl^''^^^!^9^ed a demonstration study which%will evaluate the 
usefulness of trained volunteer Emergency Medical 'Coordinators (EMCs) for 
Sfnhf! coimtunities. These EMCs are conceptualized as being 

!rS ! I^^K**^! "TP^^.^"^ nwyvated mer§>ers of ruraUomnunities who 
are trained to be first responders to medical emergencies. The EMC wJll not 
only direct^x Provide readily accesslfa^ emergency medical care,^t Jill • 
•niSc ?f ^ coonHnator, organizer, ahd informational resource for the EMS 
needs of the coranunity in wh1ch.she/be rtves. ■ f ' «-ne cr» 

'^^r'^^t ^!J°"® PH|rai=:y*and one alternate) vkll ba selected in each of 

I "^^^ of Atlanta but^eyond the suburban/ 

coBBu.ter area.^ Through the. cooperation of comminity leaders and organiza- 
^ l2^J"wfLSL^^^"?-^ school principal, the mayor, a local minister, 
t«r?J„nM?2^"i* Tl^^' fraternal groups. PTAs. local churches, 
«2I?„fSJIf"^* 3?? I^fl industry, both volunteer EMCs and sponsoring 
iSJSSf «JIJI?? "s^t.step will be to train the EMCs . 

iJnJf nJ^^? ""^^ ^""^ e«^erg^ncy care, emphasizing patient, st^bilfeation-- 
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' The training courses will make use of National Red Cross and Georgia- Heart 
Association materials and certified instructors. In axklition ,to the training 
vin first aid, •the groups will be trained in the use of the data collection 
Vorms to be used in the evaluation of this projert/ A plan will also be 
oeveloped to aid the EMCs in identification of ^rgency medical resources 
"^nd development of proper cormunication and coordination procedures. Coroiunity 
cotfiminication, cooperation and support will be ^phasized. 

Aid in attaining thit cooperation and support will include advertising 
through local -and regional media, presentation of the program by the EKC 
to various conmunity groups, and distribution of stick-on telephone cfecals 
giving erergency telephone niters including that of^ the EKC. 

The derj^f^stratian will be evaluated by assessing the elements involved in 
the development and imprt^ientation of the program, as well as more elaborate 
evaluation of EKC acceptance atid performance. The latter will include tele- 
phone aod,mail sjjrveys and incident data. 

The evaluation is cast in the framework of a stratified, ru^ltiple group, 
single-intervention,. quasi-experimental design. SeyeraKdependent variables 
will be used in the ahalysis 'including measures of community Wareness, 
comnuinity attitudes, and DC performance, as. well as response tine. Independent 
variartes will include EKC selection processes, EKC characteristics, community 
size, whether or not the community. is incorporated, and degree of financial 
commitment on the part of the communities/. 

In',si«nary, the investigators hope to learn the ^rswers to the following \ 
questions. 

Hill the concept work in reality? 

0 Does the need exist in the comrminity? 

0 Will the EHC respond 4s trained? 

0 Hill the CKTOuait:^ att^ipt to call the B^Z for help? , 

0 Can the citizen get the EK*C on the phone when needed? 

0 Is the response time for the first responder reduced? 

0 Is total access time reduced? 

' 0 Are there phone stickers on every telephone? 

Hill, the. EHC concept work from an organizational standpoint? 



* p Are EHCs likely to move away from the community? 
0 Hill .they refuse to perform? 
0 Is there community financial support? 
0 Is the community aware of the resources? 
the EHC confident of his/^er abilities? 
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0 Wha^types of EMC characteristics are associated with performance? 
0 Which types of coramunity organ izatiorvs make good spo/isors? • • 

What are the tiroe and dollar estimates to set up the program in 

Other areas- of the country? 
0 Hhat-are the factors which contribute 'to the success of the project? 

■PROGRESS : ■ i ' 

Hell in advance «f the start date of this project, the research team under- 
took cociBunity developoient efforts in over a half-dozen caimunities ^to test 
coci^nity organisation techniques and acquire time and dollar estimates for 
the organizational phase of this project. Their activities included speaking 
to local-groups such as the PTA to explore corotunity acceptance of the 
expeHnjei]t; .contacting local businesses to explore their willingness to share 
the costjof first aid' kits for ^e EKCs; establishing- rapport with owners 
of privafe aeiulance cocnpani^s serving the target cocrinunitias and explain- 
f u rCdf* ^"^^ arttulance run. reports, observations by EHTs 

of the EHCF's performance, and baseline datd;^ an(i identify4x)g. additional , 
training dourse conteirt needs. Results of this preliminary work show that 
coocunm^s accept the EKC concept readily; and that therg are enough EKCl 
candidates who- meet the'cri^ria for selection to suggest that a meaningful - 
evaluation can be c^ ducted. ^, /• 

DISSaiNATION OF RESEARCH RESULTS : - *^ 

PJans include; (1) 'The developsnent of oedia packages for corainities concerning 
EHC inple^oentatlon which will be iEi%diately- useable in other parts of the • 
cquntry* (2) several concept articles in the EKS journals,- (3) several press 
releases in the local, regional, and national media, and {4) an EKC n^sletter. 
Additionally therTlnll be presentations at professional and scientific meet- 
ings as the project progresses. , 
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SIGNIFICANCE ; ' - ' ' ' . 

There is an irmiedidte need to 'develop methods for assessing the effectiveness 
of nK)bile coronary 'care units (KCCU) in reducing rorbidity and mortal Itj^ " 
from acute myocardial infarction (AMI). Such units, ^staffed by paramedical 
personnel with advanced training jn urgency nodical care, are' being 
introduced rapidly throughout the country. While the vehicles and personnel 
are equipped and, trained to deal with many di/ferent life- threatening illnesses 
and injuries, .the emphasis has been on thei treatment .and stabilization of 
patients with acute cardiovascular ^ergencies. the expense of this equipment 
and training is substantial and, i/j a tinve of'^'increasing demands upon limited 
resources, .must be examined against the effectiveness of the systCT. 

The object of the present study is the development of a methodology for evaluat 
ing and comparing the\effectiveness of such programs in different ccxnni/nities. 
This level of emergency medical service has come" to be expected in many 
communities around the nation and new programs for the training of personnel J 
and the equipping pf vehicles for s^ch service are increasing in nuipber. The 
system in ColiEibus, Ohio^ h^ certain unique characteristics that lend them- 
selves to this type of evaluation. The HCCU program w^s started Mfi 1969 with 
a *beartmobila'^ that was actuaUy a coronary care unit on wheels-* This was . 
staffed by a cardiologist and several' emergency^medical technicians (El^fT's). 
During the first year of operation, the cardiologist carried o^t all' of the 
procedures with the assistance of the EHT's. The following year, the cardiolo- 
gist allowed the EHT's to carry out) the procedures under'his observation and 
supervision. It was finally decided that the DfT's were able to make the 
-appropriate decisions and that they had the skills required to read electro- 
cardiograms, adninister intravenous /luids and cardiovascular drugs, and carry 
out defibrillation and intubation. ^ They have sinqp worked independently, 
supportefl by a training prograr^i developed by the College of Medicine and a 
set of protocoU prepared by an Emergency Medical Services Advisory Council 
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established by the CUy of Columbus. This system tfierefore, has the appropriate 
elements for serving as a study site for the development of methodology for 
evaluation and for' the acquisition of information that will be useful to many ' 
corinumties through the country. ' ' ' 

PROJECT DESCRIPTION : * ' ' ; 

The collection of data starts with a review of the logs maintained by the' j» 
Columbus Emergency Medical Comnunication Center. From these logs, the calls ^ 
for which the MCCU's (medic units) were dispatched are identified The 

: reports submitted by the units that -were dispatched are located in the files 
.Of the Columbus Division of Emergency J^edical Services. The reports that • 
indicate possible cardiovascular emergencies are entered into'the study 
sample. At the same.tirgp, the initial calls that were made 'that Ted to the 
dispatch of the ICCU's are retrieved from master tapes oa which all calls' are 

. recorded. Typewritten transcripts are made' of these calls, a^id the message 
content coded on specially prepared forms. The repor^t forms of the KCCU's 
were also specially prepared for .the purpose of 'the present stucjy and the 
Information from these forms is qoded as well. 

V ■ ' 

The KCCU cases ^^e followed using the records of the emerge'ncy rooms- to which • 
they were transported, in order to determine the m^ical impressfort^ -Xhe 
decision regarding admission to the hospital', and the admission diagnoses, 
in each case in which the admission diagnosis indicates possible AMI, the 
attending physician is-cohtacted and permission "is obtained to interview the 

• P"^^"3.-^".^/?'' the pa-tient's family. A compreheijsive interview form is used 
to obtsin information regarding the patient's prior medical status, the 
prodromal (or early-orjset) period, the acute ofiset of illness, and the actions 
taken from the onset through entry into the urgency medical. care system. ' 

Control cases, are selecte'd -from among patients admitted to the same group of 
^Sf V^l °^ Columbus. T/Tese are patients admitted as possible- 

JHI, whj arrive at the ER by means other than the MCCU. As closely as pdsSible, 
ShphJc'^Ih jr^'^^'^^'??."^^^ age. sex, and race. The control 

'^V'r^ lv. ^^^^ ^fl^I" interviewed, utilizing ^the saoe interview forms. 
AH of the subsequent data, collection is the same :for the HCCU cases and the 
control cases, « 

. hospital, a detailed abstract is made of the hospital ' ' 

Chart including laboratory data, explications from admission to discharge. ' 
?Ifi Tu^^^"^' ^1? discharge diagnoses. The hospital chart abstracts are- 
reviewed by two cardiologists to deftermine the most appropriate diagnostic 
Classification -of each case.^ The reports of the MCCU's are also reviewed by * 

>4n ?° Jetermine the Appropriateness of the treatments given '. 

in the i)re-hospit^l phase, in relation to the established protocols. 

c 

^JJlf S ^'J^fi:^ discharged alive from the hospital are contacted six months 
Jrf Initial event to determine their functional status compared to 
f^JJJ^'tT^K^^f''^' complications of illnesses that m^y have 
^SI^ J"" ^5? '"1^''^"'' and -their requirements for medical care. All of the 
above Information Is gathered for. both .tKe HCCU cases and the co^tro cases 
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'In arfdition,^ information regarding all hospital discharged for one year was • 
obtained from all of the hospitals in the Columbus Area. From these the 
diagnoses of cardiovas.cular disease are singled out in cnrder to construct 
denominators to which the data obtained, in the present study may be related.' 
Information- obtained in the "Sudden Death Study," .that is being carried out in 
the Department of Preventive ^Medicine, is aUo used to furtber assess the 
fraction of the overalUproblem that is included Jn i:hf presgnt study. 

PROGRESS; . * ' • ' ... 

In the initial phase of the study all* forms were prepared and field tested 
for: - ' • - * " * . , 

transcription , of calls - * ' ' . ' ' 

- coding of message informatfon 
, HCCU reports - . 

. patient and family interview - • 

hospital chart abstracts • , ' 

cardiologi^st's review of hospit^al chart abstracts and MGCU 
reports ^ , s . 

' folli)w-up da'ta 

To date, the sample includes 523 MCCU cases and 526 controls. The data from 
# these forms have been coded and entered on computer tape and an initial set 
of computer runs have been^made for error, surveillarKe and for the testing 
.of a variety of programs for data analyses. It is anticipal^ed that the entire 
study sample will be completed during. the remainder of the present calendar 
year and that the study will be ready for Statistical analysis by " 
1 January 1978. tluring the first six months of 19j2, the analyses will be 
run and the final report' prepared. At the same time, a cost-effectiveness 
study of the MCCU system will be carried out by an economist on the staff of ^ 
the Department of Preventive Medicine. The object j*s to make all of the informa 
tion obtained in the study relevant to clinicians, managers of emergency 
medical syst^s, E^S research groups, and all others who are concerned with the 
development ofj)rograms for dealing with cardiovascular emergencies. 

DISS€Hn<ATION OF RESULTS: 

_ 0 

By the Fall of 1977, sufficient data will be available for* Beginning the * 
preparation cf research reports and papers on specific segments of the study. 
It is anticipated that a number of such reports and publications will be 
submitted prior to. the preparation of the final report. The final report 
itself will be compiled in a format that will|lend itself to publicatiorr as 
a book. 
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SIGNIFICANCE: 



•This study has addressed a central (Juestion: Can paraprofessionals Qsina 
protocols improve pediatric telephone service in the emergency room? Since 
most of the pediatric ^115 j;eceived in ^n emergency room pertain to ^ few 
self-l,imiting non-emergfnt conditions, f t w^s hypothesized that paraprofes- 
sionals could handle many calls ^if they were. aid^d by exp1icit4ut5eTines 
J°^Jetermining which patfents .deeded medical attention by /co|suUinS - 

■ ' .• ■ 

If -.such a systan can deliver safe care, it can be used not only in the 
emergency room, but also in other ambulatory care settings. The system will 
doubt ess be far less costly sinceHess highly trained personnel will perform 
Slf iJj' [;?w Pequfring M.D.s and R.N.s. The protocols would assure . 
uniformly high quality of care and an auditable record of teTephoneJencounters 
The systeirmay also prove more satisfactory to. patients si ncl' paraprofessionals 

. can take ample time tq asJ< and-explain the necessary questions,, to go over 
instructions.^arefully. and to follow .-the encounter With ^ subsequent phone" 
Jhl nc •* 1^'^ appears that paraprofessionals can be trained ?o respond to 

.-the psychpl^gical and .sociial concerns of th? caller. 

In short, if the paraprofessional-protocol-consultant system works, it c^n 
reduce costs, improve quality of care, and enhance patient satisfaction. The 
magnitude of such benefits may be guaged from the tremendous number of pediatric 
encpunters.by''telephone-29.2X Q| all pediatric encounters in ^1971. P^^'^^'^^'^ 

' ■ . . t 

PROJECT DESCRIPTION: \ . • '> ^ • 

-3J?4rfSn^«? proceeded in three phases, assessment of demand, development and 
validation of the system, and a -.control I^cHnlcal trial. \! 

lrll4nhnJo1?]?I'l ^Z"^^ ""'^^'^^ *° determine the r)^i^Qt and n^f^ ' 
Of telephone calls to the emergency room, and to- examine how/telMone request^ 
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for medical advice were being handled. Calls coming into the (Tit^ren's 
H^spi):aK!Mical Center emergency room were surveyed in August 1975. Calls 
were also surveyed at Harvard Community Health Plan (a large HMO) -and at Dedham 
HedicaltAssociates (a small private group practice) and again in the emergency 
room in January 1976 and May 1976. * ' . 



In the emergency rfiom^ such process indices were recordedas; 1) provider's 
identification of himself to- the caTler, 2) caller's identification of his 
relation to the child-, 3) length of the m\t to speak to a, provider, 4) length 
of . the conversation, 5) consultations required,' and, 6) whether the'calKwas 
abnormally terminated (hung-up or di sconnnected) . Three indicators of- the 
presenting 'problem were recorded: 1) age (>f the child, 2) chief coifiplajnt, and 
3) associated symfjtqms. TwO;aspects of Outcome. were also noted; 1) disposition 
(come in, stay at home) and 2) medications recommended (pone, prescription, 
' non-prescription). In the two pediatric practices, the same type of information^ 
was collected about the presenting problem and the outcome, but none about 
process. ' . • - ^ 

Phase '2 : Protocol Jlevelopment and validation aRd training^cJt the health 
assistants comprised th6 second phase' of the study. At.-first, the group 
of project physicians was asked to draft each protocol, but this method 
was found to be <:umbersome. Subsequently one physician drafted ^h^ protocol's 
and the res^ criticized and changed them. * ^ - 

There were tv/o unanticipated developments in the protocol system: one change 
' in ^format and one in concept. The protocol s ^ere ortginally to be written 
- in flow-ch|rt format: \ * 



f^as h« had diarrhea 
bef ore? 




Yes- 



Is this his usual 
stool pftttem? 



Ko 




Ko 



Is p\€ diarrhea XiXe this 
only when ^^^^ sxcK? 




^ H.A. Advice 
HEWBORN 

^ Coosult M.D. 



^ Consult M.D. 



*^ 

The flow-chart protqcojs were often sevferat pages long and did not perm^ the^, 
health assistants or a' consultant to scan the record of a ckll easily. "All 
protocols were 4;herefore translated into a -compact^ color-coded format. ' 

. : . ■ . . 

The change in concept resulted from field testing in the pediatric ppactices.. 
Although the logic aijci^ wording of the protocol sj)rovecl applice^ble to non- 
emergency services, the dispositions d.id not. g^llke emergency room providers, 
providers with a registered population t)f patients^can often risk treating a 
child at home because they know the parent's competence and the child's overall 
health. The emergency room protocols' questions were therefore retained, but 
the dispcjsitions were altered. - 



ERIC 



U8 



. 123 ' 




- _ 4 

Georg«A. Lamb, M.D. . 



Two health assistants were trained in the use of protocols. A training manu'al 
for health" assistants which documents that procedure, and allows such personnel 
to learn to'use/the protoco-ls, wilfsoon be available.. 

To asswre ihe safety of the protocols^ fonhal ass-essments were conducted of ^ 
the outcome, -protess, and content of the protocol -health assistant-consultant 
system. To evaluate' logic aiid wording (content), medical staff personnel 
re view^dHtffl'' protocols, and 12 medical reviewers listened to taped conversa- 
tions between parents and the health assistants. To confirm that questions 
were appropriate to specific complaints and that health assistants were 
responsive to the callers (process), staff members recorded and audited ^11 
calls. In addition, tapes for 'selected complaints were assessed by the peer 
reviewers. Three tests were 4Jsed to show that the protocols were unlikely 
to leave a chilcl at home if a doctor.would have had him seen (outcome). 
First, tne 12* medical reviewers gave their own disposition for each taped 
.call; this was compared, to the protocol disposition. Second, a field test 
was conducted in three sites." In the small private group practice and the 
HMO,, the protocols were used to gather data, but the usual provider made 
dispositions; thp disposition eacli system made was^ compared for the same 
call. In the emergency room,- dispositions were made directly; the charts 
of the. callers who came into the emergency room were examined to learn . 
which visits were medically apprppriate. As a^third test, 141 in-patient 
medicfal charts were retrospectively reviewed of patients admitted with ^ 
chief complaints covered by the protocols. Based on the .medical charts a 
determination was made as to whether'or n.ot the- protdctls would have reached 
safe dispositions in all cases; ^ ' , > 

Phas6 3 : After validation, the protocols were tested iff a seven-month con- 
trolJed clinical trial in the emergency room, the hMO, and a clinic 
(Comprehensive' Chi Id Health Program). Call^ for medical advice were allocated 
to the protocol system or the control system on alternate weeks. (Although' • 
calls were not "rart.domized", the weekly alternation minimized seasonal and 
longitudinal differences* between the protocol and the control calTs). 

Information was gatheret^ during the calls by health assistants of research 
staff for each group to permit comparisons -of: ^ ^ 

a) the.proces? by which the call was handled, ^ ' - 

o) the.X)utcome of the call: disposition and advice, aad 
c) the type.of problem: age' of the chfld and the complaint^. 

* " ' lb ' 

One to three 'days later, all callers were interviewed by telephone to 
ascertain: r - 

a) the caller's compliance, with advice, 
• " b) the caller's satisfaction with the encounter, and 
c) the child's subsequent health. 
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PROGRESS : * ^ 

Pt>ise 1 : The survey Yielded three main findings: a) A few types 'of complaints 
accounted for a large T)roporti on of; the calls, b). there was surprisingly 
..little variation in typ^ of complaint among the three very different settings." 
c) Calls pertaining to colds increased during winter in all three sites. 

Phase 2 : A set of 30 protocols has been developed for each type of setting, 
together with associated advice for each protocol , advice for 12 comnon health 
maintenance questions, and the training msfqual • " ' • . 

The multixph'ased evaluations of process and content verified that the protocols 
are logicaKand sufficiently clear that health assistants can, use them 
accurately while responding to the callef^s concerns. The evaluations of 
outcome "showed the protocoJ system to be safe. In each 'evaluation, we compared 
the protocol -dilated disposition to a provider's disposition that was taken 
to be. me " true " of^ppropr i ate disposition-. Patients brought in bV protocol 
but left at hoine by the provider were thus false-positives, those left at 
home by prQ:tocol but brought in by the provider were false-negatives. The 
lower the raise-negative rate, the safer the system may be considered; the 
lower the false-positive rate, the more efficient the system. The protocol ^ 
system was designed conservatively, so as to* minimize the false-negative rate 
even at the expense of a higher false-positive rate. In dther words, if* an 
error were to be made, it was considered preferable to err on the side of 
creating an unnecessary visit, rather than that*Bf^ncreasing the^risk that 
an urgen,t need for care go unrecognized or be inadequately handled ♦ 

Phase 3 : Data from the experiment in the^fie(diatric practices iire now being* 
analyzed. The follow-up survey at the HhW showed that. the parents who dealt 
with health assistants were as satisfied as those'who dealt with conventional 
providers. The compliance with' adVice of callers who spoke to hea^h assistants 
was slightly lower, though not significantly so. The practice has chosen to 
retain the system, since providers and patients are satisfied with' it., * 

In the emergency room, protocols were somewhat more conservative ("safer") than 
the house staff. Among children under 2 1/2, the protocol system brought in 
^ out of 10 callers while the house staff brought in 4 put of 10. Among other 
children, the protocol system brought in 6 of 10 and the conventional system 
brought in 5 out of . 10. There was no difference in medication. House staff 
frequently failed to ask several key questions, just as they had during the 
survey period* The hospital has expressed a desire to retain the system if 
finances permit. 

fesEHIWATION OF RESULTS: . 
^^^T ~ 

Abstracte'^'Submltted for Presentation to Professional Societies: 

1) Develbwient of Clinical Algorithms for Telephone Services. 

2J Jelephte'-Encounters in Pediatric- ER-Setting. ' 

3) Telephone Senvices in Pediatric Practice. ^ 

4) Pediatii^c Telephone Encounters; Meeting the Demand. 

5) Multi-Phase Evalulttion Techniques for Assessing Quality of. 

Care^by Paraprofes^fonals. 
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Articles- in Preparation:. ^ ' 

1) .How to ManagWhe Common Cold by Telephone. 

2) Telephone Pediatric Encounters: Meeting the Demand. • 

3) Applying Evaluation (Methodology to. Pediatric Telephone Care. 

4) A Controlled Clinical Trial of Pediatric Telephone Protocols. 

In addition, the training manual , emergency services protocols and pediatric ' 
practice protocols with 'their associated -medical advice will soon be available 
for use. 



\ 



A 



ERIC 



126 



121 




TITLE ; Treatment and Outcomes for GRANT NUMBER ; 5.R01 HS 01923 

> • Critical Patients - ' ' . . ♦ 

.GRANTEE INSTITUTION ; Hospital" Educational Foundation of Southern 

California- ■ 

PRINCIPAL INVESTIGATOR : ' FUNDING LEVEL ; None TY 77 

. : ^ . $465,550 FY 76 

Robert B.' Andrews, Ph.D. . $<D6,278 FY 75 

Associate Professor 
Graduate SchQOl of Management 

University of California a-t TOTAL PROJECT' PERIOD ; 6/30/75- 

Los Angeles « . ■ . 12/W77 

405 Hilgard Avenue / 
Los Angeles, Califorijia 29024 
(213) 825-2505 

SIGNIFICANCE ;- ' • ' • ' 

In the mid-l960Js,vthe inadequacies of existing emergency medical services 
(EMS) and, the' possibilities for tfahslating advances in medical knowledge 
into new forms of EMS began to be publicized widely. The federal govern- 
ment responded to these needs and opportunities with the passage of the' 
Highway Safety Act of 1966.' This legislation provided funds for the 
development of "some new tools for the planning and evaluation of EMS 
systems and! for introduction of experimental forms of EMS systems* In a 
ffew regions of the. country. EMS in roost of -the country, however, continued 
tO'Vag- substantially behind the known state-of-the-art. .The Emergency 
Medical Services Systems- Act of 1973 was tlie next major milestone. It set 
forth guidelines and r^uiranents for regional EMS systans and provided 
funding for the planning, es^bVisfwient, expansion, Improv^nt and opera- 

^tipr^of such regional EHS systans. It also, provided funding for EMS systans. 

^research, InclMdirtg imnning and evaluation.. 

*A critical problem remained, however. Simply stated, it was that there < 
were gaps in our understanding of those alternative system models w|iich 
would peniTit the most effective use of the available funds, whether Fedferal 
or other. The 'reason for the existence of B4S is the reduction of mortality 
and morbidity amon^ victims of medical aD^rgencies. Therefore, both existing 
EHS systems and candidate„designs for the improvement of EMS" need to be 
evaluated-priroarily in'tems of the effects that they have; or that are 
predicted, on mortality and morbidity within- the target population. The ^ 
kinds and timings, of the treatments that victims of roedtcal emergencies wiVL 
receive can be varia<f by choice and manipulation of the various eleaiente m 
EHS systans. .the means for doing 'this is to vary the treatment subsys^ 

, itself, namely the number, location, staffing and operational policl^ of 

'fixed £HS facilities and of mobile EHS units*. Iji turn*, the requirements for 
the supportive subsystems tSat provide management, transportation," communica- 

'tions, training and puWic education for EHS can be derived for any specific 

; configuration of the core treatment subsj^tenC 
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The state-of-the-art tbols for- EMS planning enable one to predict the future 
demands for EMS under. normal operating condfti^s. For any specific candidate 
EMS system design, one can also predict: (1) ^he timing with which it will 
deliver specific kinds of treatments in response to the projected pattern of 
demand -and, (2) the investmenlL and operational costs. What we cannot do is 
to predice what effects a candiiiate Ef-lS system will hav6 on the -population 
^ .it would serve. Although it. is usua,lly assumed that for critica.l patients, the 
sooner appropriate treatment is giverv, the better, thfs assumption is 
Insufficiently precise to serve as a basis for resource allocatioi^ecisions. 

For a few widely studied kinds of medical anergencies, particula/ly heart 
attacks^ wa probably have nearly enough information to provide rough estimates 
of the medical outconres for patients under different modes? of delivery of 0^. 
To make planning decisions about the level of resources to be devoted to EJ-IS ■ 
and tl<e choice of a spectfi.c design for the delivery system, however, it is 
necessary to be able to make: reasonable predictions for 'all, or at least a 
significant majority, of critica;i injuries an^ illnesses. « 

Tfie primary objective of this project is to examin^ empirica-lly the influences 
of the kiiids of, and, elap5ed time^.to, medical interventions on mortality, 
morbidity and disal^ility, of critical patients. It is intended to contribute 
to. the body of -knowledge and methodology for use in the planning of EMS 
Systans. Properly used, this knowledge should save' both lives and money, 

PROJECT DESCRIPTION ; ' - 

^either conventional descriptors, such as the name^of a disease or the nature 
of an injury,, nor existing classification 'schemes which have been developed 
for dthep purposes, provide a suitable means for categorizing patients to 
study empiricaTly the relationships between the kinds and timings of treat- 
ments and pa-tieht outcomes. A central element of the project, therefore, has . 
,b^n the development of ^ classification scheme which is appropriate for this 
purpose. The new classification recognizes that the final pathway to death 
of the individual or of a Ipmb or organ is the cessation of cellular metabolism. 
A medical emergency exists whenever the functioning of the cellular meTTbolism 
system is severely compromised. This can happen because of changes within 
the cellular metabolic system or because of compromises jn the functioning of 
either or both the ventilatory system and blood gas transport system. The 
latter systems maintain art aerobic environment for, and supply "fuel" to, the 
cells. A total of* thirteen conditions, which are based on -pathologic events 
and the anatomic levels at vftjicn they occur, were identified as an exhaustive 
listing of how the. functioning of the three body systems may be impaired. Each . 
of the ISiirteen conditipns is uniquely identified by a set of rules which employs 
indicators such as history, physical signs, laboratory results, interventions 
and- diagnoses. A /Satient may have more than oni condition. Multiple conditions 
may coniproinise one,, two, or all three body systejke ' 

Specially trained Registered Nurses, with extensive critical care or emergency 
department experience, are collecting data from medical records in hospitals 
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in Los'Angeles and Ventura Counties. They are psing the new. classification 
scheme to sort patients and precise criteria to evaluate whether or not each 
4>atient is critical, i.e., whether or not there is an immediate threat to life, 
limb or organ, . * , 

The data recorded for each patient i% tested h^f computerized editing for 
internal consistency and conipleteo&ss^. Every four to eight weeks, the relia- 
bility and consistency with which the nurses are following the rules for 
extraction of data frcxn the hospital records are tested. This is done by 
having^cb nurse evaluate the same 'set of pre-selected medical records in 
the hospital. The particular cases are selected to present different 
potential problems. The results are analyzed a^d form the basis of retrain- 
ing "wra clarification of rules and procedures, as needed. • 

The data, which are collected and edited, are stored in computerized files. 
Multivariate statistical techniques are usecfto analyze these datai" to test 
various hypotheses, and to develop parameters for theoretica7 models. 

PROGRESS ; " • ' . ^ ' 

Pilot <lata collection efforts revealed a seVies of probl^s from which it 
was possible to derive a number of conclusions thi^, in torn, modified the 
design of the project: 

1. There was great variation in the accessibility and aya^iJ^f^Hy • 
of data between hospitals and between different staff meri^^ 

f and departments within hospi^ls. 

2. Vhe staff of parti ci pa tingvQrjanizations (hospital and emergency 
mobile units), while supportTve of the project, were not able ^ 
to take the time to learn a neft classification system and apply 

it to recording patient data. This was a function not only of 
the' individual'^ attitude,' 'but also of the numbers and types of 
personnel involved (physicians^ physician specialists, nurses, 
hospital technicians,, ambulance personnel - Emergency Medical' 
Technicians levels I and II, etc.) 

3. The yield of "usable" critical cases was far lower than originally 
• estimated. "Usa1)1e" means that sufficient data were available so 
that the case could be used in the study. "Critical" cases were 
defined stringently to^nclude only patients at substantial risk 
to life if not treated, ft was originally estimated by emergency 
physicians that approximately lOX of all emergency department . 
patients were critical. Our resiUs indicate that this 10% 
consisted of patients wbo^ conqitions were "critical" (approximately 
1%),' "potentially cr1ttcaTV*Mpj» wfere those who required prompt 
treatment in order to prevent them from becoming critical 
(approximately Z%) , and "urgent" or those who needed prompt treatment 
because of anxiety, pain or^uffering even though they were not in 

f ' potentially life-threatening condit1onS|- 
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To summarize* there were limitations in the' quality of the da\a, in the actual 
number of "critical" cases available, ^nd in the extent of help that we 
could realistically expect froni providers. Our conclusions-were to: . . 

!• Increase the nuftiber of hospitals in which we would collect data 
from the seven originally projected to 28. ' 

^ Z. Increase the number of nurse data collectors from seven to 13% 

ft 

3. Orient personnel in participating organizations to the need to record 
certain itans of information more accurately* and consistently, such 
as time of onset of cri' icality and the interventions efnplpyed/ 



Intensify the training 



f the nurse data collectors 



When full scale data collection {^gan» another set of problems was 
.identified which related to the Classification systen itself. Early 
validation st^di^s shewed relatively low scores in, the consistency and- 
accuracy^ with which different nurses gathered- infonr.ation about the sar^e 
case. An analysis of the problons revealed that there were: 

1. Ambiguities in the classification scheme itself. 

2. Greater differences in clinical knowledge, experience and 
abilities of the^ nurses than originally perceivei^. 

3. ' Multiple sources of information in m^dicff'^^ecords which- were 
inconsistent. 

series of steps wffS undertakeft to deal with these issues: 

1. A revisio^of the classification scheme. 

2. A. two-week long retraining of data collectors. 

3. Elimination of some of the dat? collectors. ^ 

^ 4, Establistenent of priorities of choice^if there* were mre than 
^* one sourjce for the same piece oi^ -information. 

^ '" 

5. Establishment of a rapid response telephone consultation service 
for-nurse data collectors to answer data collection and clinical 
questions* * * 

6. Continuing validation studies, which Involved all staff periodically.- 

7. Changes of hospital assignments so th^t data collectors worke/ in 
pairs and^ould support each, other psychologically as well Ss use ^ 
each other as consultants. 

. . 130 ^5 
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We have begun collecting additional data which will allow us to describe the 
©nergeney department population more conpletely. These will include a 
breakdown of patients into categot^ies of criticality, the total nurr^ber and ^ 
distribution of potentially critical patients, ^d the numbers and descrip- _ 
tions of those patients who: (1) died prior to receiving treatment, (2) 
received no significant interventions, or (3) died of a tem^nal episode in 
the corurse of a previously diagnosed chronic illness. Nunbers and descrip- 
tions are being collected on cases which are , not adequately enougn docurented 
to be useful in this research. Such data will be of /o!}*^erab1e value to 
future Ef-lS research projects. 

.The prospect of an additional benefit hal energed ^Af^^e use of the new 
classification schenie. Medical professionals and ^araprofessionals who have 
been exposed to it as a result of the project naveVbeer very positive in their 
responses. They feel that the frarr^work has the DoX^ntial teco'^ing a 
valuable teaching. aid and of providing a unified apDrs^ch to the initial 
clinical managefr*ent of tirre-critical patients. 

To date, we have accumulated data on over 2, €00 cases and articip 
total of 5,O00; Preliminary analyses of data are currently u&der-«^ 
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Presentations = ' * - 

J. Brill, M.D. "Time to !*tedical Intervention versus Medical Outco-^s 
for Envergency Patients'" Presented. a^ Annual Conference, Arericar 
College of Erergency Physicians, Las Vegas, Nevada, Oct. 1975. 

R. Andrews, Ph.D. "Macro— Modeling Applications** 1976 International 
Conference on Cybernetics and Society, Institute of Electrical and 
Electronic Engineers, Washingtoff, O.C. 1976. 

J* Brill, M.D. "^A Ccxnrion Theoretical Framework for Emergency 
Medicine** Presented in two places - North Dakota Medical Association, 
Bismarck, N^D*, April 1977 and Ainerican Conference on Critical Care, 
Vail, Colorado, April 1977. ^ • 

A working paper describing the conceptual fram§work-*of the stiidy and the* 
classification scheme for critical conditions is available and has beeh » 
diss^nated *to interested parties throughout the country. 
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SIGNIFICANCE: 



Assessijjg the quality of oedical care ha^ bec«r6 an tncreasingly icportant 
issue In tjecent years. Concern With quality assessrient is related to the 
increasfirg cost pf riedical care, rising nalpractice insurance rates, programs 
aioed at certification and recertification' of physicians, and a cocoon 
cooplatnt orf the publip that they are not getting what they pay -for in the 
area of health care. The literature on quality assessnent distinguishes 
between process and outcocne i36as»es of quality. Process erasures relate to 
specific procedures or therapies that the physician administers to a patient. 
Outcotae fteasures relate,-*o-*^)atienfs health status at a specified tirae 
after ^e is- treated. A process-based quality assessment systen evaluates the 
, physician according to what he does - what ques'tions he asks the patient, 
*rfjat diagnostic tests and procedures he orders, and what treatc^nt he selects. 
An out^;o6je-based systen, in contrast, evaluates the physician according to the 
results he achieves, that.is* how well his paFtients respond to treatensnt. Host 
studies In- quality assessment have focused on either process, or outcotne, with- 
out atten^ting/to link the two. The present study is developing a quality 
appraisal syslfesj which includes both types of oeasures.. This study recognizes 
the principle that good oQtcoeie depends upon good care (i.e." correct process), , 
but U also recognizes that knowledge of what ccmstitutes "go^ care" is not 
always available. A quality assessment system which uses process crit^ia, 
therefore, aiust validate those criteria through appropriate outcorae_studies. 

The purpose pf the present study is to.develop a quality assurance^ system for 
^Esaergency Medical Services (EHS) which can accurately distinguish between 
appropriate and Inappropriate care, and which is cost-effective in terms of 
both manpower alTocatlon and dollar cost. Such a systera'will beBefit health ' 
care providers and aderinistrators responsible for running an EfDergency Kedioel 
Service by providing an 'objective means for oeasuri'ng quality of care and few 
iBprovtng care through educational fsedback of aucf^t results. The systesi will 
•benefit institutions by reducing vraste caused .by "over- treatment" and by ful- 
filling Federal requlr^nts for cost-control and peer 4-eview of professional 
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activities. The system will benefit patients by monitoring the ^are which 
/tl3eyx:^el^ to assure appropriate treatment and to avoid unnecHsary tests 
and pro^TOures which patients must pay for .out-of --pocket or through insurance 
premiums. Finally, all parties will benefit from the improved medical records 
£hat will result from the data generated 'by the system/ High-quality medical 
records, are essential to resolve questions about the appropriateness of medical 
practices in specific cases, especially when legal proceedings. are involved. 

The results of the study will be used to recommend the design of a general 
EMS quality assurance syste^ilwBased on preliminary findings, the following 
results and recommendations are expected to emerge from the study: 

1. The vast majority of patients who use an Emergency Service have 
relatively simp^ie, straightforward problOTS which fall into a 
small nun±ier of categories. For example, approximately 80% o^ the 
problems seerv^in the surgical area of the Yale-New Haven Hospital 
Emergency Service fall into only 10 groups, which include simple 
lacerations, simple fractures, superficial infections, and so 
forth, 

2. The proper management of each of the above problems can bSf specified . 
with a series of cl inical ^algorithms or explicit detailed maps, . 
which display the logic of medical decision making. 

3. A quality assessment systebi based on clinical algorithms will be 
capable of monitoring and improving patient care at a reasonable 
cost. By computerizing the algorithms, it is possible to audit by 
machiM lOOJ of the. ca^es falling into the 10 most'coOTon categories. 
Individual physician reviewers would b$ required only for (a) those 
cases identified by the machine as "deficienjt" according to the 
algorithcnic criteria and (b) the 20% of the patient popuTation with 
complicated or 'unusual problems not covered by an algorithm. 'Rather 
than spend the majority of his time reviewing routine^ straigtjt- 
forward cases, the physician reviewer would then concentrate on cases 
requiring his expertise and clinical judgement. 

4. A standard medical record is not adequate to provide the data necessary 
for ap algorittai-based quality assessment system. The record fre- 
quently omits data that are ^ssentfl1:to evaluate medical care, while 

- including^ther data which are superfluous for evaluation. The 
^ typical handwritten note nuist, therefore,' be replaced with a structured, 
problaiwspedific ^ta collection form. This form w^ 11 contain those 
titans requir-ed by £he pertinent algorithm and will also include space 
for/addltional copents that the physician considers important. 

Host physicians and other providers will adjust easily to using 
structured data collection instruments. Tha forms will contain a 
.serijBs of check boxes, and will require less ^ime to complete than 
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^ a handwritten note, since the physician will not have to write the 
same information time after time. More .important, the resulting 
records will be decidedly superior in terms of thoroughness &nd 
legibility. - , " • 

6. T{je implementation of a structured data collection instrument provides 
a frame work for conducting studies to test the relationship between 
therapies (processes) and patients' responses to those therapies 
(outcomes). Only a carefully structured data base makes it possible 
to form groups of patients accbrding to their clinical characteristics, 
so that outcome evaluations can compare only patients who had similar 
characteristics at the outset. 

PROJECT DESCRIPTION ; 

The present study is designed to .(a) delineate the data requirements of 
an algoritfen-based quarlity. assessment system, (b) demonstrate how to 
collect the necessary data and (c) demonstrate how to monitor and improve 
patient care by incorporating the data into an on-going quality assessment 
system. = , o • • 

To accomplish objective' (a), a series of cltnical algorithms have been 
constructed which define the data requirements for a selection of the 
problems seen roost frequently in the surgical area of the Yale-New Haven 
Hospital Emergency Service. The medital records of all patients seen for 
these problems have been abstracted onto special data collection formsrand 

<- ^'fH-.^^^^ ^^^^ "^^^ evaTu^te the care providg^-asing the clinical 
algorithms as standards. A' selection of these patients had a more complete 
medical record, filled out by a trained observer onVthe research staff who 
*ras stationed in the treatment room with the patient. " A comparison between . 
th& physician s^s^idard medical record and the observer's more complete 

' record will be. used to demonstrate that the physician's record is inadequate 
for evaluation purposes regardless of the adequacy of his clinical 

■ performance. . -. . ' 

'*i^Bject1ve (b) entails substituting a series of structuljei data collection ^ 
• forms for the standard medical record and .entering tWresul ting data into 
a^^oroputer so that the cases jpay be monitored by frtSchine according to the 
'ajgorith^. By comgaring the adequacy of the data base before and after 
introducing the structured checR lists, one can observe the. improvement 
in record-keeping due to the change im$he data collection instrument. 
Objective (cj involves using the resUTts of the machine audit to identify 
dgfl^ent or questionable care and to„feed back th^ results to the physician 
to pnJvide education to change inappropriate medical practices. 

Xhe following conceptual model will be used to evaluate the adequacy of a 
gi.¥en data source for quality assessment. Each node in a clinical algorithm^ 
contains either a decision-making criterion or an instruction to perform a 
specific task. A decision node branches into two alternative paths, and 
^conrect path depends upon whether or nlot the decision criterion is 
satisfied. Determining the correct path through th? entire algorithm involves 
the successive application of a-series of decision/criteria. • 
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Knowledge of the variables upojy which decisions are based is necessary to 
determine the correct path to be followed. Unless these variables are known, 
the evaluator cannot determine the correct path, and consequently cannot 
know which treatments are indicated, or determine ^whether the treatments, 
actually given were appropriate. 

An "adequate" data set for evaluation purposes must, therefore, include at^ 
least all the vari^rbles contained in a series of decision nodes along a 
specific path through the algorithm. Knowledge of pese data enables one 
to id^^Xy whix:h treatments are appropriate. for a particular patient* 
Assuming that one also knows* which treatments the physician tias or has no-t 
adhiinistered, one can then evaluate his performance by comparing "it with 
the, recommendations of the algorithm. Any system which considers only what 
the physician does (i.e. performance data) cannot succeed* because it is 
essential first to determine whether a patient requires a given treatment 
(i.e. decision data) in order to know that what the physician did was 
appropriate. 

A node is termed "determinant" if the variables required by the node 
can be determined from available data. Using this terminology, an ideal ^ 
data source is one which generates, for each patient, a path of nodes 
all of which' are determinant: For the purpose of making comparisons, -the 
"adequacy" of a data source may be defined as a percentage consisting of 
the number of determinant nodes divided by the total number of nodes 
encountered. The following section will explain how these concepts have 
been used to analyze the data that have been collected to date. 

PROGRESS: — ^ , ' ^ , 

Cltijical algorithms for the management of lae^fations and burns have been_^ 
developed by a panel of plastic and reconstructive surggons on the Yal€^__. 
Medical School faculty ill collaboration with the Project Director. The 
laceration a^gori.thm will be used in the discussion below to illustrate 
the method for evaluating the adequacy of a data source for quality 
assurance. 
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Formal *data collection began on September 15, 1976, after a series of data 
collection instrument pilodb tests. A total of 10,394 patients have been 
treated in the surgical area of the Emergency Service since that date, 
and their medical records have been abstracted onto a basic checklist 
containing data on patiint demographics, diagnoses, chief* complaints, 
severity index, and resource coijsumptlon. The population of 10,394 iftcluded 
* 3,187 laceration, 218'burn, arfoS^D' infection cases. These selected cases ^ 
have also been abstracted onto more detailed "clinical" checklists, contain- 
ing data on history, physical findings, treatment, and disposition. When 
these patients returned to the Emergency 3ervicefgl1ow-up clinic, a follow- 
,up Checklist was completed by the examining pKysi^an. Observers stationed in 
,.the treatment rooms have completed their own clinical checklists fori 678 
patients (574 lacerations, 39 burns, 65 infections) or 18% of the patients 
treated In the Emergencx Service for these problems. 

I 
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All data are computerized by means of an on-line data entry system, this 
sy^fem has been operational since November 29, 1976, and approximately 40% 
of the data collected to date (4,331 patients) have been entered. This 
40% sample of cases includes 189 laceration cases for which afn observer was 
present. These 189 cases have been used to derive prelimin-ary results e 
cohcerniflg the adequagy of the medical record/ Each case was traced through 
the lacera,tion algorithm and each time a. node was encountered a record was . 
ftiade indicating whether or n$g; the node was "determinant" ba-sed on the 
p.hysician'-s data {taken from the medical record abstract). Whenever, an 
Indeterminant decision node was encountered, the observer's "aJta were consulted 
in order^to decide which way to branch at that point in the algorithm. 

A series of computer^ programs was written, to perfonn the above anal^^sis, and 
the following results were obtained; 9 

^ 2229 determinant no(les 

609 indeterminant nodes ' 
2838 total nodes encountered 

(N= 189) , ^ , 

/ . • 

Based on these results; an overall coefficient of "adequacy" of 2229/2838== 
79% can be assigned to these medical records. Analogous percentages 
will be computed after the structured checklist has been substituted for 
t-he standard medical (Record, thereby providing an objective means for 
comparing the adequacy^ of ^he two data sources. 

These* preliminary results indicate that the physician neglects to -record 
approximately one-fifth of the data needed to evaluate' the care which he . 
provides. Tf\e significance of this finding from the perspective of 
evaluation i:an be appreciated by realizing that a single indeterminant 
decision node would preclude the analysis of a c^se in the absence af the 
observer's "backup'* data. All but seven of the 189 cases had at least 
one such nd^e^^Th^sOesults suggest that an EMS quality appraisal system 
cannot be bai^ on the medical record in its current form, assuming that 
these results fgr laceration. patients also hold true for other patient 
groups. 

In addition to investigating the adequacy of an Emergency Service medical 
record, -establishing an alternative structured data collection; system,-. * 
•and implementing an automated medical care audit mechanism, the studv 
Includes a method for periodically revising audit criteria. As additional 
outcome data are generated by the study, associations between process and 
outcome will be ej^amined so that a set of audit criteria 'may be developed 
which contains only'elements showf to have an jmpact on outcome. Elements 
which represent provider tradition, habit, or preference ,> but whjch have no 
demonstrable bearing on outcome, will b^ excluded from this set of. audit 
cHter^ia. ^ -^^ . 
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that have major significance fcsr policy issues of fhe »ooen£. These 
P^>ers are prepared by ie^sers of the staff of BCHSR* or by independent 
investigators. series is intend^' specif ically to inforja those in 

the public and j)tivate sectors vbo mist ctmsidKT, design, and i^lesa«jt 
policies affecting the delivery of health services. 

X 

(HI») 77-3182 Controlling the Cost of Health Care {PB 266 885) 



Ices. 




CHRA) 


77-3162 


(ERA) 


77-317^ 


(ERA) 


77-3178 


(ERA) 


77/-3192 



(ERA) • 77-3189 Drug Coverage under Hationail Health Insurance j - The 
Policy CSptiooa (in preparation) ^ 

Besear^ Beports 

®^ Search ^aport Serfes provide significant research reports in 
tl»ir entire^ t^on the «*pletion of the project, Kesearch Reports 
ara devel^pe^ iy the ^rincii^ Investigators ^ coi^ct^ the re- 
MBETdh, and are directed to selected users o£ health services research 
as part of a contiimiog nCBSR effort to «5>edite the dissemination of 
Mw Xnbvledge resiO±ing free it« project mspport* 
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Cowent HCaSR PablicatiTOS - continued 

IHKA) 76*3143 Caaputer-Based PaUent ifcnitorifig Systems (PB 266 508) 
(HRA) 77-3152 Hov Lawyers Handle Medical Malpractice Cases 

(aRP, 0014313) ^ ^ 
(EBXK 77-3159 to Analysis of the^ Southern Czaifomia Arbitration ^ 

Project, January 1966 through June 1975 (HRP 0012466) 
(HRA) 77-3165 Statutory Provisions for binding Arbitra.tion of 

' .Itedical Maapraptice Cases fPB 264 409) 
CHRA) ' 77-3184 1960 and 1970*Hi-5Panic Poptilation. of the Southwest by 

Coun^ (in prroaration) 
{ERA) 77-0188 Deaonstration^tod Evaluation of a Total Bospi-tal Infer- 

aation Systea^in preparation) 
(HRA) 77-3191 Diffusipn^'ofTwduKjlog^ Innovation in Hospitals: 
' • ' A Cas^Study of liuclear Medicine (in preparation) 



Research'^Manaqeaent 

The Reseatrch Manageaaent Series describes prpgraraatic. rather than tech- 
nical a^>ects of the liCHSR research effort. Inforxaation is presented 
on the BCHSR goals ^•research objectives, and priorities; in addition, 
this series cootains lists of grants and contracts/ and administrative 
iirformation on ftmddLng. ^Publications in this series are intended to 
bring basic information on 8CHSR and its*^ programs to research planners, 
adainistMtors, and others who are involved with the allocation of 
research resourpes* ^ 

(HRA) 76-3136 The Program in Health Services .Research (Revised 9/76) 
(ERA) 77-3158 Stssaary' of Grants and CcmtractS/ Active June 30, 1976 
, (HRA) 77-3167 ^ergency Medical Setrvices Systeas Research Projects 
' (Active as cf June 30, 1976) (PB 264 407, -available * 
wnS only) 

^(HRA) *7T-:;Sl79' Research on the Priority Issues of the National Center 
for Healtii Services Research^ ^ants and Contracts 
'Active on Jtoe 30, 1976 
(HRA) 77-3183 Recent Sttidies in Health, Services Research, Vol. II 
(C? 1976) (in preparatix>n) - 



'RBMBsrch Proceedings^ * t • . \ ^ 

Die JResearch Proceedings Series extends the availability of x»r re- 
search announced at Xey conferences, ^ysposla and seminars sponsored 
or «5©«t^iy SCHSR^ In Addition to ^perB presented, publications • 
itir Hi^n^i^ Inclt^e ^iicussions and responses iirtjenever possible. 

i^ljis iM intended to help sieet the informatioh needs of health 
servioM proviSars and oarers who require direct access to ccmcepts 
and idear cvoli^tng .frcs the exdiaoge of research results* 

(m) 77-3138 lfc»en and ^eir Healthj Research Ia5>iications for a 
Hew Era tPB 264 359, available KTIS only) 



Currwt NCHSR Publications - continued 

<HRA) 76-3150 Interraountain Medical Malpractice (PB 268 344, avail- 
able NTIS only) 

(HRA) 77-3154 Advances in Health Sxxrvey Research Methods 

(HBA) 77-5181 NCHSR Research Conference Report on Consxaner Self-Ceure 
in Health (in preparation) 

(ERA) 77-3186 Intemationzd Cpnfer^nce on Drug Jind Pharmaceutical 
^ ' Services Reimbursement (in preparation) 
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